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ABSTRACT 


This  research  report  is  intended  to  provide  a basic 
clarification  of  the  decision  structure  and  methodology 
for  the  design  of  a high  technology,  large  scale  system 
with  emphasis  on  integration  of  human  factors  and  their 
associated  metrics.  The  report  summarizes  and  relates 
the  design  morphology  to  current  USAF  methodology  for  the 
management  of  system  design,  defines  and  classifies  human 
factors  which  influence  the  decision  structure  of  design, 
and  clarifies  the  nature  of  subjective  and  objective 
requirements  which  are  inputs  to  the  decision  structure. 
The  conceptual  framework  developed  as  an  effective  ap- 
proach to  the  solution  of  the  problem  of  human  factors 
inclusion  into  the  design  morphology  is  that  of  a three 
dimensional  matrix  representing  the  relationship  among 
human  factors,  the  design  steps,  and  the  current  litera- 
ture. This  relationship  allows  for  explicit  human  fac- 
tors inclusion  during  the  preliminary  design  phase  of 
a new  system  and  the  resultant  inclusion  in  the  criteria 
function  for  the  optimal  design  configuration. 
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1.0  INTRODUCTION 

The  research  resulting  from  this  project  Is  Intended 
to  clarify  the  decision  structure  and  methodology  for  the 
design  of  a high  technology,  large  scale  system  with  em- 
phasis on  integration  of  human  factors  and  their  associ- 
ated metrics.  This  effort  was  Initiated  after  many  years 
of  study  and  development  of  a methodology  [14]  that  suc- 
cessfully Integrates  the  necessary  decisions  to  efficient- 
ly utilize  resources  In  order  to  meet  a design  need.  In 
effect,  a morphology  of  design  emerged  from  which  econop- 
1c  applications  can  be  readily  achieved.  The  potential  to 
the  United  States  Air  Force  (USAF)  of  this  morphology  was 
recognized  by  the  members  of  the  Air  Force  Office  of  Sci- 
entific Research  (AFOSR)  and  the  Air  Force  Human  Resources 
Laboratory  (AFHRL),  and  the  problem  of  effectively  Including 
human  factors  Into  the  design  or  plan  for  USAF  systems  was 
chosen  as  the  Initial  vehicle  for  study. 

Hore  specifically,  this  study  reviews  recent  devel- 
opments In  the  design  morphology.  Identifies  relevant 
human  factors,  and  clarifies  subjective  and  objective 
Inputs  Into  the  decision  structure.  A bibliography  was 
developed  [15]  to  accomplish  two  specific  study  goals. 

The  first  was  to  permit  the  University  of  Houston  re- 
searchers to  supplement  their  awareness  of  the  current 
developments  In  both  the  design  literature  and  human 


factors  literature.  The  second  goal  was  to  provide  a 
current,  relevant  compendium  of  annotated  titles  that 
are  useful  to  the  researchers  and  to  other  agencies  and 
individuals.  These  goals  were  met. 

Of  major  concern  to  USAF  is  the  proper  integration 
of  human  factors  into  emerging  systems  so  that  performance 
criteria  for  these  systems  will  properly  reflect  the  in- 
fluence of  these  factors.  There  appears  to  be  » reluctance 
on  the'  part  of  equipment  designers  to  accept  this  "soft'* 
data  as  an  input  to  the  design  of  equipment,  particularly 
when  there  is  difficulty  in  meeting  the  more  easily  iden- 
tified hardware  performance  requirements.  Hence,  the  im- 
proper inclusion  of  human  factors  in  USAF  equipment  affects 
results  in  the  type  of  equipment  which  :an  perform  well 
when  operational,  but  achieving  the  adequate  operational 
state  cannot  be  met  with  the  planned  human  resources. 

Designers  have  shown  a willingness  to  include  human 
factors  data  that  have  been  quantified  and  are  available 
to  the  design  process  [5,  page  8]  What  is  needed  is  a 
methodology  that  explicitly  allows  for  the  inclusion  of 
these  relevant  factors  into  the  design  process. 

Prior  research  [1],  [14],  [17],  has  resulted  in  such 
a methodological  approach  to  the  design  process  and  its 


appllctitfon  to  the  Air  Force  design  problem  will  be 
through  the  accomplishment  of  three  major  objectives: 

? i Clarification  of  the  decision  structure  and 
mathcdology  for  the  design  and  Implementation 
of  a high  technology,  large  scale  system 

2]  Definition  and  classification  of  human  factors 
which  Influence  the  decision  structure  of  design 

3)  Investigation  of  the  analytical  methods  for  the 
successful  Integration  of  qualitative  and  quan> 
tative  Information  Into  a multivariate  cr1> 
terlon  function.  The  first  two  have  been  ac- 
complished within  the  scope  of  this  research; 

'.he  last  Is  planned  for  the  next  two  years. 

1.1  SCOPE  OF  THE  PROJECT 

The  research  begins  with  a review  of  the  literature 
describing  design  decision  structures  and/or  dealing 
with  human  factors  relevant  to  system  design.  The  human 
factors  are  then  classified  for  Integration  Into  the 
design  and  for  feasibility  of  quantification. 

The  design  morphology  used  Is  that  of  Ostrofsky  [14]. 
This  particular  rationale  emphasizes  the  system  life  cycl 
and  the  clarification  of  subjective  and  objective  Inputs 
to  the  design  decisions.  In  addition,  a detailed  des- 
cription of  the  process  demonstrates  the  Inclusion  of 


human  factors  In  system  design.  Examples  showing  the 
Importance  of  human  factors  analysis  in  design  corslder- 
atlons  are  given. 

This  research  will  construct  a three  dimens  * •■'al 
matrix  representing  the  formal  relationship  among  htman 
factors,  the  steps  of  the  design  morprology,  and  the 
existing  literature.  This  Is  accomplished  by  formally 
defining  the  major  (or  basic)  categories  of  human  factors 
as  they  relate  to  each  step  In  the  design  morphology. 

The  major  publications  In  the  current  human  factors  lit- 
erature as  identified  by  the  researchers  [15]  are  then 
related  to  the  respective  human  factors-design  pair.  To 
facilitate  the  relating  of  the  current  literature  to  the 
human  factors  categories  a limited  demonstration  data 
base  Is  developed  (see  Appendix  B). 

Finally,  potential  areas  for  future  Investigation 
Including  needed  analytical  design  methods  are  defined 

1.2  BACKGROUND 

The  system  engineering/system  management  procedures  - 
developed  by  USAF  [17]  during  the  1960's  Identified  the 
philosophy  and  the  details  of  Implementation  for  USAF 
systems.  This  documentation  went  to  the  extent  of  Iden- 
tifying reporting  deteils  for  each  activity  during  the 


system  life  cycle  and,  while  it  left  the  designer  free  to 
improvise,  it  constrained  his  activities  to  definable  and 
reportable  categories. 

In  the  1970's  guides  for  acquisition  management  were 
made  available  [19],  [20],  [21],  [22].  One  pamphlet  [19], 
for  example,  covered  the  general  considerations  during  the 
management  of  a program  and  is  of  interest  to  all  program 
management  personnel.  It  provided  an  overview  of  project 
activities  from  conception  through  deployment  and  reflected 
the  recent  changes  in  acquisition  policy  issued  by  the  De- 
partment of  Defense  (DOD).  This  guide  will  be  used  in 
this  research  to  establish  a basis  for  the  Air  Force  sys- 
tem life  cycle  and  design  process. 

Independently  of  the  USAF,  Professor  Asimow  [1]  in 
1962  delineated  a philosophy  and  a rationale  for  the  de- 
sign of  a technological  system.  This  rationale  defined 
a decision  structure  required  to  use  resources  optimally 
in  attempting  to  meet  design  objectives. 

In  1962  Ostrofsky  began  formal  study  of  this  method- 
ology and  developed  Asimow's  rationale  into  a viable  set 
of  procedures  for  accomplishing  the  decisions  inherent  in 
the  design  of  a system.  These  procedures  were  delineated 
in  detail  and  redefined  by  constant  application  in  engi- 
neering and  management  classes  in  the  university  and  practice 


in  industry  until  a set  of  rules  and  theorems  concerning 
designer  behavior  and  decision  sequencing  were  clearly 
established  and  publishable  [14]. 

The  inclusion  of  human  factors  in  system  design  has 
been  the  topic  of  extensive  research  in  recent  years.  A 
brief  review  of  this  research  is  given  later  in  this  re- 
port, as  well  as  reviewed  in  the  bibliography.  However, 
there  appears  to  be  a gap  between  human  factors  a.ialysis 
and  system  design.  This  research  attempts  to  bridge  the 
gap  by  showing  how  human  factors  properly  identified, 
classified,  and  quantified,  can  be  included  into  the  de- 
sign process. 

1.3  LITERATURE  REVIEW  AND  BIBLIOGRAPHY 

A review  of  the  literature  describing  the  design 
decision  structure  as  it  relates  to  the  development  of 
aerospace  systems  as  well  as  identifying  the  human  re- 
source factors  relevant  to  the  design  structure  has  been 
conducted.  The  result  of  this  activity  is  an  annotated 
bibliography  [15]  which  is  used  in  this  research  to  com- 
plement the  design  morphology  by  identifying  and  cate- 
gorizing the  human  factors  for  inclusion  in  the  decision 
structure . 

Three  basic  points  have  emerged  from  this  literature 
search.  First,  both  the  engineering  design  and  the  human 


factors  literature  voice  strong  agreement  on  the  need  for 
the  Integration  of  human  factors  into  the  system  design 
process.  Although  a practical  and  consistent  approach  has 
not  yet  emerged,  both  areas  are  sufficiently  developed  to 
consider  the  influences  upon  each  other  in  a unified  pro- 
cedure for  system  design. 

Secondly,  the  human  factors  data  currently  available 
generally  lack  standardization  and  clarity  for  design  ap- 
plications. While  special  purpose  data  files  have  been 
created,  the  very  aspect  of  their  specialization  often 
limits  their  applicability  to  the  many  broad  disciplines 
required  for  large  scale  system  design  [7]. 

Finally,  there  appears  to  exist  an  urgent  need  for  an 
Interdisciplinary  data  base  describing  and  quantifying  the 
human  factors  essential  to  system  design.  The  ensuing  re- 
search will  attempt  to  make  some  progress  in  this  direction. 

It  is  apparent  that  no  one,  relatively  brief,  liter- 
ature search  such  as  this  can  completely  cover  the  existing 
literature  in  both  the  design  decision  structure  and  the 
human  resource  factors.  However,  this  effort  is  offered 
as  a beginning  and  should  be  continually  supplemented  and 
updated. 
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2.0  U.S.  AIR  FORCE  LIFE  CYCLE  DESIGN 


2.1  BACKGROUND 

Early,  the  United  States  Air  Force  recognized  the 
need  for  viewing  long  term  effects  of  their  decision 
making  as  it  related  to  the  design  of  new  systems  and  to 
the  ability  to  support  such  new  systems  In  the  field.  The 
design  and  planning  of  a new  system,  with  regard  to  the 
costs  and  benefits  throughout  the  life  of  the  system,  lead 
to  System  Life  Cycle  Planning,  and  many  documents  have  been 
published  by  USAF  to  guide  designers  in  their  path  to  suc- 
cessful achievement  of  goals.  However,  System  Life  Cycle 
Planning  has  never  been  a static  concept.  Rather,  it  has 
been  a basic  philosophical  approach  which  has  lent  itself 
to  refinement  and  modification  over  the  years  as  method- 
ology has  advanced  with  the  state  of  the  art,  as  the  exi- 
gency for  military  hardware  demanded,  and  as  the  forces 
of  political  pressure  were  satisfied. 

A review  of  the  Air  Force  literature  £17],  [18],  [19], 
[20],  [21],  [22],  describing  the  system  acquisition  pro- 
cess over  the  past  10-15  years  does  reveal,  however,  a 
thread  of  continuity  as  to  how  the  Air  Force  views  the 
life  cycle  design  process.  Six  phases  of  the  life  cycle 
design  process  have  been  identified  in  this  study  (see 
Figure  2-1).  These  phases  and  the  associated  definitions 


are  a composite  view  or  a perspective  of  the  life  cycle 
phases  utilized  by  the  Air  Force.  Because  the  Air  Force 
acquisition  process  Is  dynamic  and  specific  terms  and 
definitions  are  subject  to  change,  this  view  of  the  Air 
Force's  life  cycle  phases  provides  a common  basis  for 
analysis  and  methodological  development. 


CONCEPTUAL 

VALIDATION 

FULL-SCALE  DEVELOPMENT 
PRODUCTION 
OPERATIONS 
RETIREMENT 

Figure  2.1  Six  Phases  of  U.S.  Air 
Force  Life  Cycle  Design 
Process  (Adapted  from 
[17]) 

2.2  LIFE  CYCLE  PHASES  - A PERSPECTIVE 
2.2.1  Conceptual  Phase 

The  conceptual  phase  begins  when  national  defense 
objectives.  Intelligence  estimates,  threat  Information, 
foreign  technology,  conceptual  studies,  and  feasibility 


studies  provide  Air  Force  planning  organizations  with  the 
Information  necessary  to  determine  the  requirement  for  a 
new  capability  [17,  page  28].  The  conceptual  phase  ex- 
tends from  the  determination  of  a needed  operational  ca- 
pability to  the  program  decision  which  authorizes  the 
Initiation  of  the  validation  phase  [19,  page  2-1].  For 
the  purposes  of  this  discussion  It  Is  assumed  that  a 
given  system  proceeds  through  the  life  cycle  phases, 
remembering  that  not  all  capabilities  which  are  Identi- 
fied as  being  needed  will  survive  the  evaluation  and  anal- 
ysis of  the  design  process,  let  alone  the  political  pro- 
cess necessary  to  obligate  the  funding  needed  to  bring 
a given  system  on  line. 

! 

"The  conceptual  phase  Is  a highly  Iterative  process 
with  activities  performed; simul taneously  and/or  sequen- 
tially as  the  basis  for  the  acquisition  are  established 
by  policy,  fiscal,  analytical,  experimental,  and  engi- 
neering efforts  accomplished  at  the  various  levels  within 
the  Department  of  Defense.  The  objective  of  ...(this 
phase)...  Is  to  define  and  select  the  system  concepts 
which  warrant  further  development."  [19,  page  2-1]. 

The  output  of  the  conceptual  phase  Is  an  Identified 
preferred  system  configuration  along  with  any  Identified 
alternative  system  configurations.  Four  points  must  be 
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satisfied  before  the  design  process  may  proceed  to  the 
next  phase: 

"1)  Mission/performance  envelopes  are  adequately 
defined,  technically  feasible,  and  capable  of 
achieving  the  stated  objectives  within  reason- 
able cost  and  schedule  constraints 

2)  Military,  technical,  and  economic  objectives 
are  sound,  needed,  reasonable,  and  well  defined 

3)  Major  uncertainties  are  Identified  for  further 
Investigation  during  the  validation  phase 

4)  Preliminary  cost  and  schedule  estimates  are 
based  upon  sound  analyses  and  are  commensurate 
with  the  degree  of  certainty  In  the  other 
aspects  of  the  program."  [19,  page  2-1] 

2.2.2  Validation  Phase 

The  purpose  of  the  validation  phase  Is  the  testing 
and  refinement  of  the  system  concepts  by  extensive  study 
and  analysis,  hardware  development,  or  prototype  testing. 
This  may  be  the  first  phase  In  which  a formal  request 
for  proposal  (RFP)  solicitation  will  be  used  to  Initiate 
the  contracting  process  [22,  page  40].  During  the  vali- 
dation phase,  the  system  characteristics  [def'lgn  require- 
ments) are  translated  Into  performance-type  specifications 


(as  opposed  to  restrictive  detailed  design  specif icationi. ) . 
To  accomplish  this  objective  the  system  functions  are 
subdivided  into  system  segments,  subsystems,  and  compo- 
nentf  with  the  corresponding  performance  requirements  and 
design  constraints  being  identified  [13,  page  3-5],  The 
development  of  prototypes  or  models  usually  occurs  for 
the  evaluation  of  design,  performance,  and  production 
potential  [19,  page  3-7].  A major  activity  during  this 
phase  is  the  performance  of  engineering  design  studies 
which  are  part  of  an  optimization  process  aimed  at  achiev- 
ing a balance  between  such  factors  as  total  cost,  schedule, 
and  operational  effectiveness  [19,  page  3-8]. 

Before  proceeding  to  the  full-scale  development 
phase,  the  following  objectives  of  the  validation  phase 
must  have  been  satisfied: 

"1)  System  trade-offs  (studies)  have  produced  a 
balanced  and  realistic  set  of  performance 
parameters. 

2)  Risk  areas  have  been  identified  and  reduced  to 
acceptable  levels. 

3)  Cost/schedule  estimates  for  full-scale  develop- 
ment are  acceptable. 

4)  Contractual  aspects  are  sound  (type  appro- 
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priate  to  risk  and  funding  related  to  mile- 
stones)." [19,  page  3-13] 


2.2.3  Full-Scale  Development  Phase 


During  the  full-scale  development  phase,  the  com- 
plete system.  Including  support  Items,  is  brought  through 
the  final  design  phase,  a fully  operational  version  of 
the  system  fabricate!,  and  testing  and  evaluation  is  con- 
ducted by  contractors  and  the  Air  Force.  An  initial  ver- 
sion of  the  system  which  closely  approximates  the  final 
product  is  produced,  the  engineering  documentation  nec- 
essary to  enter  the  oroduction  phase  is  developed,  and 
the  system  evaluatiun  test  results  which  demonstrate  the 
attainment  of  the  required  performance  parameters  are 
conducted  f19,  page  4-1].  In  sum,  the  output  of  this 
phase  Is  a system  that  has  demonstrated  its  supportabi 1 ity , 
produciblllty,  and  operational  feasibility  [21,  page  4]. 

During  this  phase,  the  design  activity  develops  de- 
tailed drawings  for  the  fabrication  of  the  preproduction 
prototype,  emphasizing  the  interfacing  of  system  components 
and  the  system  with  other  systems.  The  engineering  ef- 
fort Is  primarily  concerned  with  system  design  integration. 
Interface  control,  the  optimization  of  the  final  design, 
effectiveness  analysis,  and  the  resolution  of  known  or 
potential  problem  areas  [19,  page  4-2].  And  from  the 
production  standpoint,  the  analysis  of  produci bi 1 i ty  and 
the  identification  of  new  production  problems  is  inten- 
sified.* 

Given  that  the  above  activity  is  successfully 
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concluded,  the  major  milestone  remaining  for  this  phase 
Is  the  approval  to  proceed  Into  the  production  phase. 
The  approval  decision  (by  the  Secretary  of  Defense  for 
major  systems]  follows  a review  of  the  system's  devel- 
ment  which  must  confirm: 

"a)  the  need  for  producing  the  defense  system 
In  consideration  of  threat,  estimated  ac- 
quisitlon  and  ownership  costs  and  potential 
benefits  In  contest  with  overall  ...  (Depart- 
ment of  Defense)...  strategy  and  fiscal 
guidance 

b)  that  a practical  engineering  design,  with 
adequate  consideration  of  production  and 
logistics  problems  Is  complete 

c)  that  all  previously  Identified  technical 
uncertainties  have  been  resolved  and  that 
operational  suitability  has  been  determined 
by  test  and  evaluation 

1 

d)  the  realism  of  the  plan  for  the  remainder  of 
the  program  " f2Q,  Attach.  2,  pages  9,10]  1 

2.2.4  Production  Phase  \ 

The  purpose  of  the  production  phase  Is  to  effi- 
ciently produce  and  deliver  to  the  operating  unit  an* 
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effective  supportable  system  at  optimum  cost  [19.  page  5-1]. 
To  satisfy  these  system  requirements  the  producer  must 
maintain  efficient  control  of  the  factors  of  production 
(manpower,  material,  and  real  property  facilities),  quality, 
and  finished  product  Inventory  [IS,  page  5-3]. 

To  accomplish  this  objective  the  Air  Force  maintains 
a tight  surveillance  of  contractor  production  operations 
to  monitor  progress  assessment;  detection,  reporting, 
and  timely  solution  of  production  difficulty;  evaluation 
of  documentation;  review  of  manufacturing  methods  and 
techniques;  and  assessment  of  contractor  production 
management  [19,  page  5-2]. 

The  testing  begun  during  the  full-scale  develop- 
ment phase  Is  often  continued  during  the  production 

! 

phase.  In  addition,  the  using  command  Initiates  oper- 
ational testing  and  evaluation  of  early  production 
models  to  detect  and  correct  unacceptable  deficiencies 
at  the  earliest  opportunity.  This  testing  Includes  an 
assessment  of  the  system's  operational  capabilities 
and  develops  the  most  effective  operational  tactics, 
techniques,  doctrine,  and  standards. 

Because  of  the  long  production  run  times  Involved 
with  mnst  of  these  high  technology  systems,  the  system 
end-items  become  available  for  distribution  to  the  user 
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over  an  extended  time  horizon.  This  concept  of  a pro- 
tracted delivery  scheme  Is  referred  to  as  the  deployment 
of  the  system.  System  deployment  overlaps  the  production 
and  operation  phases  of  the  system  life  cycle*  and  of- 
ficially rnds  with  the  receipt  of  the  final  production 
unit. 

2.2.5  Operations  Phase 

The  operations  phase  begins  with  the  receipt  of  the 
Initial  system  end-item  by  the  using  organization.  This 
phase  Is  concerned  with  the  employment  of  the  system  to 
counter  the  threat  and/or  provide  the  capabilities  for 
which  It  was  designed.  Included  Is  an  on-going  process 
of  developing  doctrine*  tactics,  and  standards  for  em- 
ploying the  system;  the  training  of  operators  and  support 
personnel;  Integrated  logistics  support;  and  the  evolu- 
tion of  proposed  system  modifications  to  meet  a changing 
operational  environment  and/or  maintain  or  Improve  sys- 
tem sped f 1 cations . The  operations  phase  may  extend  for 
decades*  with  Its  termination  dependent  upon  the  system's 
abil Uy  to  satisfactorily  provide  a needed  capability. 
When  the  system  is  no  longer  needed,  its  orderly  re- 
tirement becomes  necessary. 

2.2.6  Retirement  Phase 


The  retirement  phase  begins  when  the  system  Is 


removed  from  active  operational  service.  The  federal 
government  operates  under  an  elaborate  system  for  the 
redlstf^lbutlcn,  sale,  and  the  recycling  of  obsolete 
systems.  However,  the  main  concern  form  the  perspective 
of  this  report.  Is  the  active  planning  and  consideration 
of  system  retirement  In  terms  of  planning  a system's 
total  life  cycle.  The  criticality  of  this  view  might  be 
evidenced  In  the  need  to  explicitly  plan  for  the  safe 
disposal  of  nuclea^  wastes  or  other  undesirable  effluents 
or  by-products  of  a complex  system.  The  authors  did  not 
find  mention  of  this  aspect  of  systems  design  explicitly 
discussed  In  the  Air  Force  publications  reviewed.  The 
legal  requirements  for  performing  environmental  Impact 
studies,  however,  do  provide  for  the  Implicit  Inclusion 
of  this  factor. 


3.0  DESIGN  MORPHOLOGY 


3.1  BACKGROUND  - INTRODUCTION 

The  Introduction  of  this  study  stated  the  purpose 
of  this  research  to  be  the  application  of  a methodology 
consisting  of  a sequential  decision  structure  necessa  'y 
for  the  design  of  a USAF  system.  To  achieve  this  pur- 
pose, Ostrofsky's  design  morphology  [14]  Is  used  with 
USAF  systems  taken  as  a direct  application. 

Ostrofsky  notes  that  the  methodology  does  not  of 
Itself  guarantee  a successful  solution  to  the  design 
problem:  no  methodology  can  do  this  for  all  problems. 
However,  It  does  Increase  the  likelihood  of  reaching 
the  "best"  possible  solution  with  an  efficient  use  of 
available  resources.  As  will  be  seen  later,  "best"  Is 
defined  In  terms  of  criteria  which  are  explicitly  ie- 
Hneated.  Since  some  criteria  are  directly  related  to 
human  factors,  the  Inclusion  of  these  human  factors 
Into  the  emerging  system  by  this  methodology  Is  criti- 
cal and  Is  approached  dlrectlv. 

This  morphology  also  establishes  a close  relation- 
ship between  the  design  process  and  the  life  cycle  of 
the  system  under  consideration.  Design  and  production- 
consumption  phases  are  Identified  and  can  be  directly 


related  to  the  USAF  life  cycle  phases  discussed  in  the 
preceding  section. 

The  design  morphology  with  Its  wide  applications 
Is  described  In  the  text  [14]  and  represents  a compre- 
hensive philosophy  for  system  design.  The  book  then 
represents  the  prime  reference  for  this  discussion. 
Moreover,  since  the  morphology  semantics  are  very  pre- 
cise, some  basic  definitions  are  required  and  are  given, 
as  needed,  throughout  this  discussion. 


A direct  comparison  between  the  USAF  life  cycle 
and  that  of  the  design  morphology  Is  given  In  Figure  3,1 
Note  that  there  exists  a one-to-one  correspondence  be- 
tween the  phases.  Also,  note  the  absence  of  the  dis- 
tribution phase  In  the  left-hand  column.  This  distri- 
bution phase,  which  accomplishes  the  phase-in  of  the 
system  for  Its  users,  closely  corresponds  to  deployment 
which  overlaps  both  the  production  and  operations  phases 
of  the  USAF  system  l|fe  cycle.  The  definitions  for  pro- 
ductlorv,  operations , jand  retirement  of  both  approaches 
are  almost  equivalent  and  will  be  discussed  In  the  next 
section.  The  three  design  phases  that  yield  the  final 
form  of  the  system  Include  the  sequential  activities 
which  structure  the  form  and  content  of  the  design 


process . 


AIR  FORCE  LIFE  CYCLE  PHASES 


DESIGN  MORPHOLOGY  PHASES 


CONCEPTUAL 

FEASIBILITY  STUDY 

VALIDATION 

PRELIMINARY  ACTIVITIES 

FULL-SCALE  DEVELOPMENT 

DETAILED  ACTIVITIES 

PRODUCTION 

PRODUCTION 
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OPERATIONS 

OPERATIONS 

RETIREMENT 

RETIREMENT 

Figure  3.1  A Comparison  of  U.S.  Air  Force  Life  Cycle  Phases  to 
the  Phases  of  the  Design  Morphology 

Tho  "feasibility  study  " is  the  first  design  phase 
and  corresponds  to  the  conceptual  phase.  Its  purpose 
is  the  development  of  a set  of  useful  solutions  to  the 
design  problem.  Thus  it  identifies  the  needs,  formulates 
the  problem,  synthesizes  a set  of  solutions,  and  screens 
them.  The  identification  of  the  problem  is  accomplished 
by  means  of  an  Input-output  matrix,  where  the  rows  are 


/ 
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the  production-consumption  cycle  phases  (production, 
distribution,  operations,  and  retirement),  and  where 
the  columns  consist  of  Intended  (or  needed)  Inputs,  en- 
vironmental (or  existing)  Inputs,  and  desired  and  unde- 
sired outputs  (see  Figure  3.2).  As  will  be  discussed 
later,  this  matrix  plays  an  Important  role  In  facili- 
tating the  inclusion  of  human  factors  In  the  design 
process.  Each  synthesized  solution  Is  referred  to  as 
a candidate  system  which,  by  definition.  Is  "a  parti- 
cular configuration  of  each  of  a group  of  subsystems 
such  that  every  function  and  activity  related  to  the 
total  system  would  be  accomplished  If  the  candidate 
system  were  completely  developed"  [14,  page  47].  Can- 
didate systems  are  synthesized  from  concepts  or  approaches 
to  the  solution  of  the  problem.  Since  the  objective  of 
the  feasibility  study  Is  to  select  the  solutions  which 
warrant  further  development,  the  candidate  systems  must 
be  screened  to  meet  the  fiscal,  analytical,  experimental 
and  engineering  requirements  and  policy  of  the  Department 
of  Defense. 


Inputs  Outputs 


Intended 

Environmental 

Desired 

Undesired 

Production 

Distribution 

Consumptlon- 

Operatlon 

Retirement 

Figure  3.2  The  Input-Output  Matrix 


The  second  design  phase  Is  "Preliminary  Activities," 
and  corresponds  to  the  validation  phase.  This  phase 
Identifies  the  "best"  candidate  system  In  terms  of  well 
defined  criteria.  For  this  purpose,  criteria  are  re- 
lated to  parameters  and  to  attributes  of  the  alternatives, 
and  a value  Is  assigned  to  a criterion  function  for  each 
candidate  system.  Once  Identified,  the  chosen  system 
Is  tested  and  Its  performance  over  the  life  cycle  Is 
predicted.  Engineering  design  trade-off  studies  dis- 
cussed earlier  can  be  considered  as  the  major  activity 
of  this  design  phase. 

The  third,  and  final  design  phase  Is  the  "Detailed 
Activities"  or  full-scale  development,  and  Is  undertaken 
once  the  optimal  or  "best"  candidate  system  has  been 
chosen.  These  activities  Include  the  adequate  review  of 
all  Information  and  data  to  this  point,  the  development 
of  details  of  the  system  by  means  of  engineering  drawings, 
assembly  Instructions,  the  specification  of  organization, 
production  and  operations  plans,  and  finally,  experi- 
mental constructions.  If  these  activities  are  not  com- 
pleted prior  to  the  production  phase,  costly  changes 
will  probably  ensue  which  usually  eliminates  most  of  the 
time  savings  anticipated. 

Note  that  of  necessity,  knowledge  of  the  Immediate 


design  problem  Is  usually  Incomplete  when  decisions  aee 
made,  hence  causing  the  Iterative  nature  of  design  by 
leading  to  a reexamination  process  throughout  the  mor- 
phology. Furthermore,  the  designer  must  pursue  a policy 
of  least  commitment  stated  as  follows:  "In  progressing 
from  step  to  step  In  the  morphology,  no  Irreversible 
decision  should  be  made  until  It  must  be  made"  £14, 
page  21].  This  principle  t.ius  allows  the  designer  to 
avoid  eliminating  an  alternative  which  may  turn  out 
after  reexamination  to  be  optimal,  and  proves  to  be 
the  most  efficient  procedure  for  completion  of  the  design 
activities. 

3.2  PRODUCTION  - CONSUMPTION  PHASES 

The  activities  of  the  design  phases  are  accomplished 
to  anticipate  the  needs  of  the  production-consumption 
cycle.  Obviously,  then,  the  designer's  problem  Is  to 
understand  the  requirements  of  each  phase  of  the  pro- 
duction-consumption cycle  to  a depth  adequate  for  reso- 
lution of  problems  during  these  phases,  since  changes 
occurring  after  the  start  of  the  production  phase  will 
be  much  more  costly  than  changes  or  Iteration  occuring 
prior  to  the  start  of  the  production  phase.  This  sec- 
tion, then,  describes  the  nature  of  the  production- 
consumption  cycle  phases. 


3.2.1  Product! on 


Production  Is  the  set  of  activities  for  the  "trans- 
formation of  goods  or  services  Into  a more  useful  form" 
[14,  pa^e  201].  "As  the  first  class  of  activities  In 
the  production  consumption  cycle,  many  of  the  major  needs 
and  constraints  for  the  designer-planner  emerge  from 
this  phase  of  the  activities"  114,  page  9]. 

3.2.2  Distribution 

Distribution,  also  referred  to  as  deployment, 
accomplishes  the  phase-in  of  the  production  output 
to  the  operator  or  user,  'he  distribution  activities 
should  provide  flexible  and  effective  methods  for  accom- 
plishing the  transfer  and  Integration  of  the  produced 
system  to  the  required  locations  and  for  assuring  the 
start-up  of  smooth  operations. 

3.2.3  Operations 

In  the  operations  phase,  the  system  Is  operated 
to  meet  the  user  needs  directly.  The  operation  of 
the  system  is  usually  more  difficult  to  control  than 
production  and  distribution  because  of  the  greater 
variation  In  the  characteristics  of  the  users.  On  the 
other  hand,  this  phase  generally  determines  the  major 
criteria  for  system  acceptance,  thus  creating  the  fol- 
lowing designer's  dilemma;  "...how  to  reasonably  limit 
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the  expenditure  of  resources  in  determining  operational 
requirements  while  simultaneously  obtaining  the  best 
overall  performance  from  the  entire  morphology"  [14, 
page  12].  While  no  universal  solution  to  this  problem 
exists,  the  morphology  gives  a structured  decision  pro- 
cess which  provides  the-  designer  with  a clearer  insight 
into  operations  requirements  and  performance,  and  re- 
sults in  more  effective  systems  for  the  criteria  defined. 

3.2.4  Reti rement 

During  this  phase,  the  system  is  withdrawn  from 
its  intended  functions  in  operation.  This  implies 
either  the  replacement  of  the  system  or  a modification 
of  its  o’^iginal  uses.  In  both  cases,  there  are  many 
important  implications  for  the  design  of  the  system. 

3.3  DESIGN  PHASES 

The  three  design  phases  - feasibility  study,  pre- 
liminary design,  and  detail  design  - consist  of  a number 
of  sequential  activities  which  ensure  a complete  and  thor- 
ough approach  to  the  solution  of  the  problem.  These 
activities  provide  a logical  transition  from  the  clear 
and  complete  definition  of  a need  to  the  detailed  deve- 
lopment of  a system  to  satisfy  that  need.  It  is  impor- 
tant to  note,  however,  that  while  the  sequence  of  the 


design  steps  It  relatively  rigid,  the  Iterative  nature 
of  the  process  permits  the  full  exercise  of  judgement 
and  past  experience  throughout  the  design  process.  So 
that,  as  the  design  process  continues  and  additional 
knowledge  Is  gained.  Iteration  of  previous  design  ac> 
tivlty  Is  required  to  Improve  the  decisions  made  at 
these  earlier  steps. 

3.3.1  Feasibility  Study 

The  purpose  of  the  feasibility  study  is  to  synthe- 
size a set  of  solutions  to  meet  the  Identified  needs. 
Since  this  phase  of  the  design  process  Identifies  the 
set  of  candidate  systems  from  which  the  optimal  alter- 
native emerges,  any  Inadequacies  In  this  phase  are  car- 
ried  forward  to  subsequent  phases.  The  feasibility 
study  Is  thus  the  foundation  for  the  design  phases  to 
follow  and  can  appreciably  simplify  subsequent  decisions 
when  accomplished  properly, 

A feasibility  study  consists  of  four  Important 
steps:  11  analysis  of  the  needs,  2)  Identification 
and  formulation  of  the  problem,  3)  synthesis  of  solu- 
tions, and  4)  screening  of  the  candidate  systems. 

First,  the  needs  must  he  clearly  defined  In  order 
to  Justify  the  subsequent  expenditure  of  resources.  If 


this  step  Is  not  adequately  accomplished,  the  probable 
solution  resulting  from  this  morphology  will  not  meet 
the  original  needs  and  substantial  losses  may  be  In- 
curred. Research  of  the  past,  present,  and  future  re- 
quirements of  the  production-consumption  cycle  of  the 
system  must  be  conducted  resulting  In  an  objective 
definition  of  the  needs.  Objectivity  Is  required  to 
eliminate  as  much  as  possible  the  prejudices  and  pre- 
conceptions of  the  designer.  Often,  a test  program  to 
verify  the  existence  of  certain  needs  Is  used  In  the 
analysis,  and  finally,  a statement  of  goals  emerges  and 
the  designer  Is  ready  to  proceed  to  the  Identification 
and  formulation  of  the  problem,  the  next  step. 

This  relates  In  detail  the  needs  previously  defined 
to  the  production-consumption  phases  of  the  life  cycle 
and  bounds  the  various  aspects  of  the  problem  Into  a 
finite  set  of  objectives  so  that  the  designer  can  pro- 
ceed with  realistic  goals  In  view.  This  Is  accomplished 
with  the  use  of  an  Input-output  matrix  CFIgure  3,2)  In 
which  desired  and  undesired  outputs  as  well  as  Intended 
and  environmental  Inputs  are  Identified  as  completely 
as  possible  at  this  stage  of  the  design  process.  While 
environmental  Inputs  represent  existing  conditions  and 
available  resources,  the  Intended  Inputs  are  supplements 
to  the  environmental  Inputs  needed  to  enable  the  achieve- 
ment of  outputs.  The  resulting  matrix  Includes  In  each 


cell  descriptors  which  are  a function  of  the  knowledge 
available  at  the  time  the  matrix  Is  constructed.  The 
continuous  Improvement  In  the  state  of  knowledge  con- 
cerning the  problem  and  consequently,  the  improvement 
of  the  Input-output  matrix  as  the  designer  proceeds 
through  the  morphology  are  examples  of  the  Iterative 
nature  of  design. 

Bounding  the  problem  by  means  of  the  Input-output 
matrix  provides  an  efficient  approach  to  the  synthesis 
of  solutions  to  the  design  problem.  This  creative  step 
of  the  design  process  results  in  concepts  and  candidate 
systems  [14,  page  47]  which  are  tailored  to  the  uniquely 
defined  needs.  The  concepts,  which  are  basic  approaches 
to  the  solution  of  the  problem,  relate  to  the  depth  de- 
fined by  the  needs  analysis  and  problem  Identification. 
For  every  concept,  the  different  functions  to  be  accom- 
plished are  then  Identified  and  grouped  Into  subsystems. 
Next,  alternative  candidate  systems  are  obtained  by  com- 
bining exactly  one  alternative  for  each  subsystem  within 
a concept  such  that  every  function  related  to  the  total 
system  Is  accomplished.  Note  that  the  level  of  the  con- 
cept, and  thus,  the  number  of  candidate  systems,  are 
directly  related  to  the  pointedness  of  the  needs. 

• 

Finally,  the  development  of  a set  of  candidate 
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systems  must  be  accompanied  by  a preliminary  examination 
which  assures  that  the  systems  being  considered  are 
feasible.  The  screening  of  the  candidate  system  relates 
to  Its: 

a)  physical  realizability,  defined  as  "the 
ability  to  actually  achieve  the  combination 
of  subsystems  or  functions  defined  In  the 
concept"  [14,  page  57]  , 

b)  economic  worthwhileness,  or  the  value  re- 
ceived from  the  completion  of  a given  can- 
didate will  merit  the  expenditure  of  resources 
required  to  develop  It,  and 

c)  financial  feasibility,  which  Identifies  the 
actual  sources  of  funds  needed  to  accomplish 

i 

. the  project.  ! 

While  there  may  be  other,  more  explicit  screens  for  a 
given  system,  these  "macro"  screens  serve  to  relate  to 
all  systems. 

3.3.2  Preliminary  Design 

The  set  of  possible  candidate  systems  synthesized 
In  the  feasibility  study  becomes  the  Input  to  preliminary 
design.  The  purpose  of  preliminary  design  activities  Is 
to  select  the  candidate  system  which  best  meets  the 


Identified  needs.  This  Is  accomplished  through  an  op- 
timization process  which  permits  the  designer  to  fully 
comprehend  the  nature  of  his  "design  space."  The  ac- 
tivities are:  1)  preparation  for  analysis,  2)  definition 
of  design  criteria,  3)  definition  of  parameters,  4/  cri- 
terion modeling,  5)  formulation  of  a criterion  function, 

6)  analysis  of  the  parameter  space,  7)  formal  optimization, 
8)  prediction  of  system  behavior,  and  9)  testing  and  sim- 
plification. 

Quite  often,  there  is  a time  gap  between  the  com- 
pletion of  the  feasibility  study  and  the  beginning  of 
the  preliminary  activities.  This  time  period  can  be 
used  to  reassess  the  decisions  of  the  first  design  phase 
(the  feasibility  study)  In  light  of  new  Information  and 
to  reexamine  relationships  between  needs,  problem  Iden- 
tification, concepts  and  candidate  systems.  A good 
approach  to  this  reexamination  Is  to  group  candidate 
systems  by  attributes  or  by  subsystems  and  to  list  ad- 
vantages and  disadvantages  of  the  different  groups.  The 
purpose  of  this  activity  is  twofold:  first,  to  under- 
stand the  nature  of  the  criteria  to  be  met  by  the  emerging 
tmdidate  system;  second,  to  study  the  nature  of  candi- 
date systems  for  a given  concept  and  the  qualities  of 
the  different  concepts. 


The  Ideal  design  seeks  the  "optimum"  candidate 
system,  the  one  which  Is  theoretically  the  most  favor- 
able for  some  defined  criteria.  However,  any  design 
methodology  must  settle  for  the  "optimal"  candidate 
system,  the  most  favorable  for  the  criteria  and  set  of 
candidates  defined.  Thus,  criteria  present  the  measures 
against  which  performance  of  a system  Is  evaluated.  These 
criteria  must  emerge  from  the  needs  analysis  and  problem 
formulation  of  the  feasibility  study,  and  usually,  from 
the  output  columns  of  the  Input-output  matrix.  A major 
cause  for  the  Inadequacy  of  many  systems  Is  the  fact  that 
"any  criterion  not  considered  will  not  be  Included  In 
the  choice  of  the  optimal  candidate"  [14,  page  80].  Thus, 
when  an  element  Is  In  reality  a criterion  but  not  Included 
as  one,  a design  methodology  for  finding  the  optimal  can- 
didate will  not  Include  this  criterion  no  matter  how  ex- 
plicit the  methodology  may  be.  The  adequacy  of  the  needs 
analysis  and  problem  Identification  tends  to  ensure  that 
all  the  Important  criteria  are  Included. 

When  more  than  one  criterion  exists,  a relative 
value  or  weight,  a^,  must  be  assigned  to  every  criterion 
Xj  (Figure  3.3).  Furthermore,  It  has  been  shown  [14, 
Appendix  C]  that  the  a^  should  be  structured  such  that 

^i^a^  « 1 0 < a^  < 1 (1) 
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Since  the  are  vital  to  the  choice  of  the  optimal 
candidate  system,  any  data  or  information  that  can  be 
obtained  to  help  evaluate  them  may  be  worth  the  resource 
expenditure  required"  [14,  page  84]. 


Criterion,  x. 

1 

Weight,  a^. 

^1 

^2 

^3 

^3 

a 

n 

n 

Figure  3.3  Criteria  and  Relative  Weights 

Usually,  the  criteria  defined  for  a given  system 
cannot  be  directly  measured  for  every  candidate  system 
The  criteria  must  then  be  related  to  measurable  vari- 
ables which  can  emerge  from  an  understanding  of  the 
nature  and  characteristics  of  the  set  of  candidate  sys 
terns  (Figure  3.4).  Three  different  types  of  criterion 
constituents  can  be  distinguished: 


a)  Parameters,  or  elements  that  are  directly 
measurable,  denoted  by  yj^ 

b)  Submodels,  or  elements  that  can  be  modeled 


from  other  parameters,  denoted  by  Zj 

c)  elements  Mhich  cannot  be  directly  measured. 

If  these  are  crucial  to  the  adequate  assessment 
of  candidate  system  performance,  some  method 
must  be  devised  to  estimate  them  quantitatively. 
This  usually  Implies  the  addition  of  laboratory 
or  field  studies. 


Figure  3.4  Constituents  of  a Criterion  for  a Set  of  Candidate  Systems 


The  procedure  which  consists  of  assigning  a code 
to  every  criterion  element,  according  to  Its  type,  Is 
repeated  for  a11  the  criteria  (see  example  In  Figure 
3.5).  The  elements  are  then  reexamined  for  consistency 
(no  synonyms),  completeness  (exhaustive  listing),  and 
compactness  (combination  of  common  elements).  Finally, 
the  submodels  are  related  to  their  corresponding  para- 
meters (see  example  In  Figure  3.6). 
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Figure  3.5  Criteria  and  Elements 
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Figure  3.6  Relating  Submodels  to  Parameters 
for  al 1 Criteria 


Since  the  objective  is  to  determine  the  optimal 
candidate  system*  all  criteria  are  combined  into  a 
single  criteria  function  and  the  performance  of  each 
candidate  system  is  evaluated  by  defining  the  value  of 
this  function  for  that  system.  The  criteria  function 
is  constructed  from  a combination  of  criteria  and  their 
respective  relative  values  (Figure  3.7).  A cardinrl 
scale  emerges  from  this  criteria  function,  and  permits 
the  identification  of  the  optimal  candidate  system  as 
well  as  establishing  a ranking  for  the  candidate  systems 
in  the  defined  set. 


35 


Criterion  Function  (CF) 


Figure  3.7  Criterion  Function  Constituents 

Furthermore,  the  set  of  parameters  {yj^}  can  be 
related  to  the  set  of  criteria  defined  for  the  evaluation. 
This  usually  requires  mathematical  modeling  and  results 
in  quantitative  relationships  between  the  criteria,  the 
parameters,  and  the  submodels.  Note  that  "the  accuracy 
of  these  relationships  is  a direct  function  of  the 
knowledge  available  from  past  experience,  mathematical 
capability,  the  literature  in  the  area,  and  current 
investigation  and  testing"  [14,  page  98]., 


Thus , 


(2) 


and  since: 

then:  *1  “ (4) 

Having  completed  the  criterion  modeling,  the 
designer  must  determine  the  range  or  allowable  spread 
of  each  parameter  (Figure  3.8).  A candidate  system 
with  values  of  parameters  outside  these  ranges  Is  not 
a feasible  candidate;  thus,  careful  consideration  must 
be  given  to  the  determination  of  these  ranges.  Narrow 
ranges,  for  example,  will  exclude  a number  of  candidate 
systems  Ranges  for  submodels  and  for  criteria  can 
then  be  determined  using  mathematical  models  obtained 
earlier  (Figures  3.9  and  3.10). 
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Range  of  Parameters 
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Figure  3.10  Range  of  Criteria 


Finally,  the  criteria  must  be  combined  into  a func- 
tion which  can  yield  a single  value  Indicating  the  per- 
formance of  the  candidate  system  on  a cardinal  scale. 
Probability  theory  can  be  used  to  synthesize  the  criterl 
function  by  mapping  multiple  criteria  onto  a single  pro- 
bability space  [14,  Appendix  C].  This  method: 

1)  Provides  a means  for  assessing  the  complete- 
ness of  the  set  of  candidate  systems  in  terms 
of  the  range  of  criterion  performance.  Thus, 
candidates  which  might  not  have  been  otherwise 
considered  are  revealed. 

2)  Assesses  the  magnitude  of  the  criteria  Inter- 
actions that  exist  and  have  significant  effects. 


It  has  been  shown  that  the  criteria  and  their  Inter 
actions*  can  be  mapped  Into  a multivariate  probability 
space  and  the  resulting  criteria  function  for  candidate 
system  a takes  the  following  form: 


CF^  ■ I «,  P(A,)  - ? I P(A,j) 

* J 

1/j 


1-1 


n n 


M n 


6 . .. 
1 jk 
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^ n n n 

' { 1 J+1  *ijk...(J+l) 


J^J+1 


where 

5 Criterion  random  variable 

= Value  of  criterion  random  variable  with  range 

*1m1n  - ^1  - *1max 

= the  event  (X^  < x^,  Xj  < x^jj 


Aj+1  " “jtl) 


where  J + 1 = n 


6^  P(A^) 


= Marginal  distribution  function  of  the 
1^^  criterion. 

{1.  when  P(A^)  exists 
0.  when  P(A^)  does  not  exist 

6ljP(Aij)  = joint  probability  or  the  first-order 
Interaction  of  x^  and  x. 

fl , when  P(A . . ) exi sts 
ij 

0.  when  P(A^-j)  does  not  exist 

probabfmy 

or  the  J*"  order  Interaction  of 


^1jk...{Jtl) 


Lo.  when  PCA^jl^  (J+1)^  exist 


This  equation  defines  the  relative  value  of  a candidate 
system  In  the  Interval  [0,1]  and  Includes  both  the  relative 
Importance  a^  of  the  respective  criterion  x^  and  the  value 
of  the  probability  density  of  the  x^.  When  the  value  of 
a candidate  system's  performance  Increases  with  the  per- 
formance Itself,  the  most  desirable  candidate  system  Is 
the  one  which  yields  the  highest  value  of  CF.  Furthermore, 
the  problem  of  Identifying  additional  candidate  systems 
can  be  related  to  the  problem  of  Identifying  a particular 


value  of  CF  within  the  design  space  and  relating  the 
respective  to  their  physical  significance.  To  mini- 
mize the  risks  and  uncertainties  introduced  by  the  de- 
signer's incomplete  knowledge,  the  design  space  should 
be  carefully  analyzed  and  In  this  manner,  the  designer 
Increases  his  understanding  of  the  nature  of  the  value 
structure  and  the  manner  In  which  it  relates  to  the 
candidate  systems.  Analyzing  the  design  space  Involves 
the  following  general  types  of  analyses: 

1)  Sensitivity  analysis 

2)  Compatibility  analysis 

3)  Stability  analysis 

The  sensitivity  analysis  Identifies  the  rate  of  change 
of  the  criterion  function  CF^  to  each  of  the  parameters  yj^ 
and  to  each  of  the  submodels  z..  This  shows  the  nature 
of  the  change  In  the  criteria  function  resulting  from 
variations  In  the  parameters,  yj^,  or  the  submodels,  Zy 
and  permits  the  designer  to  understand  better  the  nature 
of  his  design  space,  thus  enabling  more  effective  opti- 
mization to  occur. 

In  contrast  to  sensitivity,  the  compatibility  analysis 
Identifies  those  parameters  or  submodels  having  the  least 
effect  on  the  total  CF  value.  When  changes  become  neces- 
sary during  subsequent  equipment  development,  they  should 


occur  first  In  those  areas  which  are  least  sensitive. 

The  stability  analysis  permits  the  designer  to  Iden- 
tify the  limits  of  performance  prior  to  system  breakdown 
and  requires  an  understanding  of  the  nature  of  the  ef- 
fects upon  the  system  of  exceeding  criterion  limits. 

This  type  of  comprehension  of  the  design  space,  then. 

Is  necessary  for  the  designer  to  adequately  assess  the 
subsequent  choice  of  the  optimal  candidate,  and  Is 
accomplished  from  study  of  the  nature  of  criteria  Inter- 
actions and  their  meaning  on  the  performance  of  the 
candidate  system  [14,  page  128]. 

At  this  point,  after  a thorough  study  of  each  of 
sensitivity,  compatibility,  and  stability,  formal  opti- 
mization can  occur.  For  the  set  of  candidate  systems 
Involved,  two  basic  steps  are  Involved.  The  first  can 
be  viewed  as  "optimization  within  the  candidate  system" 
and  determines  for  each  candidate  system  that  combination 
of  parameter  values  which  provides  the  optimal  value  of 
the  criterion  function.  The  second  process,  "the  opti- 
mization among  candidate  systems,"  is  simply  the  candidate 
system  having  the  "best  value  of  the  criteria  function. 
Note  that  selection  of  the  "best"  value  of  CF  does  not 
necessarily  give  the  "optimal”  candidate  unless  the 
CF^  for  the  given  candidate  has  been  optimized  for  that 
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candidate  ("optimization  within")  prior  to  "optimization 
among"  candidates  [14,  page  134]. 

Serious  constraints  to  the  design  space  studies  are: 

1)  the  required  level  of  mathematical  sophistication, 

2)  extensive  computer  usage,  and  3)  limitations  to  ac- 
curacy resulting  from  practical  considerations  In  the 
Implementation. 

Having  selected  the  optimal  candidate  system.  It  Is 
now  necessary  to  reexamine  the  environment  In  which  the 
system  will  operate  to  assure  consistency  between  the 
future  environment  and  the  chosen  system.  Considerations 
Include  the  nature  of  the  socioeconomic  environment  and 
the  system's  rate  of  technological  obsolescence.  In 
general,  this  Implies  a reexamination  of  the  problem 
formulation  Input-output  matrix. 

Next,  attempts  should  be  made  to  predict  the  perfor- 
mance of  the  optimal  system,  cost  estimates  should  be 
prepared,  and  remedial  action  Is  taken  If  costs  exceed 
the  bounds  defined  In  the  needs  analysis. 

To* verify  these  projections  and  estimates,  the  system 
and  Its  elements  are  finally  tested  and  evaluated  to  the 
extent  practical  at  this  time.  The  testing  usually  re- 
veals areas  In  which  the  design  can  be  simplified  and  the 


system  can  be  Improved  and  when  this  occurs.  Iteration 
of  all  affected  decisions  must  occur  In  orde**  to  be  com- 
pletely safe  on  subsequent  decisions. 

3.3  DETAIL  DESIGN 

The  activities  of  the  detail  desiqn  are  those  ne- 
cessary to  develop  and  Implement  the  optimal  system 
selected  In  the  preliminary  design.  The  Importance  of 
the  feasibility  study  and  preliminary  activities  Is 
emphasized  by  the  fact  that  most  of  the  resources  are 
expanded  In  the  Implementation  of  the  production-con- 
sumption phases.  Therefore,  ”1t  Is,  In  general,  less 
costly. to  make  errors  during  the  earlier  phases  of  the 
design-planning  process  where  the  effort  Is  primarily 
analytical  than  to  make  them  during  the  detail  activities 
after  expenditure  of  time,  effort,  and  usually,  large 
amounts  of  money"  [14,  page  155}. 

The  detail  activities  begin  with  the  preparation  for 
design  which  consists  of  the  adequate  review  of  all  In- 
formation and  da^a  to  this  point.  The  possible  Improve- 

! 

ment  of  the  knowledge  discussed  should  be  considered. 

1 

For  example,  the  functional  relationships  between  the 
criteria  and  the  parameters  may  warrant  a reevaluation. 

As  for  the  particular  detail  activities  to  be  per- 
formed, these  vary  with  the  type  of  system  under 


consideration.  Host  USAF  systems,  however,  have  similar’ 
types  of  dtcisions  to  he  made  and  these  include: 


1)  The  design,  according  to  the  morphology,  of 
the  subsystems,  components  and  parts  that  make 
up  the  total  system.  As  the  design  progresses 
down  through  the  various  levels,  the  requirements 
become  much  more  precise  and  better  defined. 

2)  The  listing  of  accurate  and  complete  assembly 
Instructions  ranging  from  simple  hardware 
elements  to  large-scale  systems  such  as  an 
aircraft.  Tables  and  exploded  views  can  be 
effectively  used  to  provide  instructions. 

3)  Experimental  construction  to  look  for  possible 
refinements  and/or  major  changes  which  must  be 
made. 

4)  Cost  projections  for  labor,  materials,  management, 
facilities,  and  the  various  support  functions 
required  to  produce,  distribute,  operate,  and 
retire  the  system. 

5)  The  consideration  of  the  different  logistics 
functions  which  provide  reinforcement  in  ac- 
complishing primary  system  functions.  The 
integrated  logistics  support  elements  are: 
maintainability  and  reliability,  maintenance 


plan,  support  and  test  equipment,  supply  support, 
transportation  and  handling,  technical  data, 
facilities,  personnel  and  training,  support  re- 
source funds,  and  support  management  Information. 

6)  The  development  of  an  organization  plan  for  the 
accomplishment  of  the  tasks  required  to  effectively 
meet  the  needs  of  the  production-consumption  cycle. 

7)  Production  planning  with  such  considerations  as 
type  of  production  (Intermittent  versus  con- 
tinuous), Inventory  control,  forecasting,  sched- 
uling, assembly  sequencing,  plant  layout,  quality 
control  and  testing. 

8)  Operations  planning  to  assure  efficient  Imple- 
mentation and  support  of  the  produced  system. 
Logistics  plays  an  Important  role  In  operations 
planning  because  "It  provides  for  the  proper 
Integration  of  the  diverse  needs  of  each  area 
of  Interest"  [14,  page  230]. 

When  the  detail  design  Is  cuMipleteu,  the  technical 
performance  of  the  developed  system  through  Its  production- 
consumption  cycle  Is  predicted  to  ensure  the  satisfaction 
of  the' designer ' s original  needs  and  the  accomplishment 
of  thr  necessary  adjustments.  Costs  are  once  again 


analyzed  and  an  overall  review  Is  conducted  to  Improve 
or  simplify  any  facet  of  the  system.  Note  that  "Im- 
portant changes,  when  uncovered,  should  be  considered 
In  the  standard  procedures  of  design-planning  changes 
and  the  affected  steps  Iterated  In  the  basic  design. 
Often,  however,  when  redesign  will  lead  to  major  changes 
and  the  Improvement  will  require  more  resources  than 
can  be  effectively  used  on  this  system,  the  changes  are 
kept  for  the  next  generation  of  design"  [14,  page  241]. 


48 


4.0  HUMAN  RESOURCES  IN  THE  DESIGN  CONTEXT 

The  study  of  human  resources  as  they  impact  upon 
the  design  of  a system  is  not  a new  undertaking,  and  the 
volume  of  literature  published  on  the  subject  is  over- 
whelming. The  general  discipline  has  come  to  be  known 
variously  as  human  factors  engineering,  or  simply,  human 
factors,  biomechanics,  engineering  psychology,  or  ergo- 
nomics [11,  page  ^ii].  McCormick  has  stated  in  summary 
that  human  factors  engineering  can  be  considered  the 
process  of  designing  for  human  use  [11,  page  3].  At 
this  point  a more  precise  definition  of  the  composition 
of  human  factors  is  in  order. 

4.1  DEFINITION 

David  Meister  [12]  has  defined  human  factors  as  a 
general  term  with  precise  meaning  determined  by  the  con- 
text of  its  useage.  First,  he  defined  human  factors  as 
those  elements  which  influence  the  efficiency  with  which 
people  can  use  equipment  to  accomplish  the  functions 
of  that  equipment.  Second,  the  term  may  refer  to  the 
number  and  type  of  personnel  selected  to  run  the  system 
and  how  they  function.  Third,  the  term  may  be  used  to 
refer  to  the  level  of  personnel  performance  necessary 
in  using  the  equipment  and  the  effect  of  that  performance 
on  other  system  elements  or  on  overall  system  goals. 
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And  finally,  the  term  can  be  used  to  refer  to  the  effect 
of  the  overall  system  upon  Its  personnel  elements  [12, 
pages  5,6]. 

In  other  words,  the  human  factors  are  not  discrete 
concepts  with  simple  and  finite  definitions;  but  rather, 
they  comprise  a broad  discipline  for  examining  man's 
position  In  the  man-machine  system.  The  basic  concept 
of  the  man-machine  system  Is  a closed-loop  relationship 
between  the  human  and  his  equipment.  Helster  [12,  page  9] 
defines  the  major  elements  of  this  system  as  equipment, 
environment,  tasks,  and  personnel.  Each  of  these  In 
turn,  consists  of  many  subelements,  each  of  which  may 
Influence  the  efficiency  of  the  man-machine  system.  The 
human  Interface  to  this  system  Is  complex  and  requires 
management  of  the  joint  efforts  of  psychology  and  en- 
gineering If  optimal  design  decisions  are  to  result. 

4.2  Background 

Although  the  study  of  human  resources  In  the  design 
context  Is  not  a new  phenomenon,  the  major  Impetus  oc- 
curred during  World  War  II  [11,  page  4;  12,  page  1C]. 
During  this  time  the  disciplines  of  Industrial  engineering 
and  psychology  corroborated  on  human  factors  research 
with  a 'Strong  appllcatlons-orlentatlon.  The  emergence 
of  new  high  technology  systems  which  Imposed  Increasing 


and  specialized  demands  on  personnel  led  to  suggested 
ways  of  improving  performance  through  improved  system 
design  [12,  pages  16,  17]. 

The  research  psychologist  and  the  engineer  were 
thus  thrust  together  by  the  exigency  of  the  times. 

However,  the  need  for  direct  continuing  communication 
has  become  all  the  more  necessary  because  design  pro- 
blems and  their  attendant  solutions  have  increased  in 
complexity  apace  with  the  technological  explosion  since 
World  War  II.  Moreover,  the  corroboration  of  psycholo- 
gist and  engineer  is  a continuing  process  within  a given 
system  design  program  because  design  problems  and  solu- 
tions tend  to  change,  sometimes  markedly,  as  the  iter- 
ative process  of  system  development  progresses  (12, 
page  17].  The  proper  inclusion  of  human  factors  into 
the  system  design  is  dependent  upon  the  availability  of 
relevant  quantifiable  data  as  an  input  to  the  decision 
process . 

The  inclusion  of  hjman  factors  in  system  design  has 
been  the  topic  of  a growing  body  of  research  in  recent 
years  (see  [5],  [15]).  The  thrust  of  the  research  has  been 
at  developing  methods  of  accomodating  a successful  and 
standardized  approach  to  the  inclusion  of  human  factors 
in  system  design.  A basic  philosophical  schism  between 


the  behavioral  1st  and  the  scientist  has  led  to  con- 
tinuing problems  during  practical  applications  while 
In  theory  the  psychologist  and  engineer  are  In  agreement 
on  the  necessity  for  their  corroboration.  Askren  [5] 
summarized  a number  of  studies  which  have  as  their  aim 
the  Identification  of  a methodology  for  assuring  the 
Inclusion  of  human  resources  In  the  design  process.  He 
characterized  the  types  of  human  resources  data  relevant 
to  the  design  process  as  follows: 

“A  wide  variety  of  human  resources  data  were  found 
to  be  useful  as  criteria  In  design  studies.  This  In- 
cluded such  factors  as  manpower  quantity,  technician 
skill  level,  technician  job  specialty,  personnel  dollar 
cost,  type  and  amount  of  training,  task  performance 
time,  job  difficulty,  and  personnel  turnover  rate  ... 
the  type  of  data  relevant  to  a particular  design  pro- 
blem Is  a function  of  the  nature  of  the  design  problem. 
All  human  resources  data  do  not  apply  to  all  design 
studies.  It  Is  critical  to  provide  the  engineer  with 
data  that  Is  most  relevant"  [5,  page  9], 

4.3  HUMAN  RESOURCE  CATEGORIES  FOR  DESIGN 

For  the  purposes  of  the  approach  to  the  Inclusion 
of  human  factors  data  Into  the  design  process,  a sys- 
tem of  human  factors  categories  was  necessary  to  provide 
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a reference  for  the  collection  of  relevant  data  pertinent 
to  anticipated  design  problems.  During  the  analysis  of 
the  feasibility  study  for  the  design  of  a particular 
system,  the  human  factors  categories  relevant  to  the 
design  problem  under  consideration  could  be  Identified. 
This  would.  In  turn,  lead  the  designer  to  an  appropriate 
entry  point  of  the  human  factors  data  base  where  the 
data  most  relevant  to  the  design  problem  would  be  avail- 
able to  the  engineer. 

In  selecting  a system  of  human  factors  categories 
It  was  felt  that  Keister's  four  categories  [12]  did  not 
give  a sufficiently  detailed  breakdown  for  this  use. 
Robert  Blanchard  [7],  on  the  other  hand,  Identifies 
sixteen  categories  of  human  resources  data.  His  types 
of  data  are  Identified  according  to  the  requirements  of 
the  users  and  with  some  modification  became  the  basis 
of  our  thirteen  human  factors  categories.  A comparison 
of  these  thirteen  categories  with  Keister's  four  cate- 
gories Is  lllustrajted  In  Figure  4.1. 

The  following  definitions  of  the  Individual  cate- 
gories come  largely  from  Blanchard  [7,  pages  30,  31]; 


1.  Human  Capabilities;  Human  capabilities  relate  to 
the  physiological  as  well  as  behavioral  limitations  of 
the  Individual.  They  Illustrate  the  functional  relations 
between  the  various  human  processes  and  the  equipment 
and  task  parameters. 


2.  Behavioral  Considerations;  The  behavioral  consider- 
ations' Include  such  factors  as  personnel  motivation, 
group  dynamics,  productivity,  and  job  satisfaction,  and 


relate  to  the  outcome  of  personnel  activl 


ties. 


3.  Personnel  Cost;  Personnel  costs  are  a function  of 
team  size  and  composition,  training  level  required  to 
accomplish  the  task,  and  the  level  of  associated  Indi- 
rect charges  for  overhead.  While  relating  mostly  to 

i 

dollar  costs,  costs  can  also  relate  to  time  and  equip- 
ment requirements. 


4.  Training  Level;  Training  level  relates  to  the  formal 
and  on-the-job  training  (OJT)  for  various  personnel 
classes  which  allows  them  to  reach  the  required  perfor- 
mance levels  on  various  personnel  functions.  The  training 
level  Is  a function  of  the  tasks  to  be  performed  and 
the  qualifications  of  the  personnel. 


5.  Personnel  Performance:  Personnel  performance  relates 
to  the  accomplishment  of  the  different  tasks  of  the  sys- 
tem. Standards  are  associated  with  critical  personnel 


activities  for  various  systems.  Achievement  of  standards 
should  Insure  attaining  a prescribed  level  of  system 
performance. 

6.  Team  Performance;  Team  performance  Is  the  set  of 
activities  specified  by  the  designed  system,  the  task 
to  be  performed,  and  the  operating  environment.  It  Is 
a function  of  group  Interaction  and  Integration,  and 
evaluated  against  defined  criteria. 

7.  Man-Machine  Interface:  Man-machine  Interface  con- 
siders the  relation  between  the  human  and  a wide  range 
of  specific  hardware  components  with  various  physical 
characteristics  and  human  performance  levels. 

8.  Personnel  Background;  Personnel  background  Involves 
a relationship  among  such  factors  as  educational  levels, 
aptitude  testing,  and  personnel  skill  level. 

9.  Personnel  Readiness;  Personnel  readiness  for  various 
tasks  on  operating  systems  relates  to  performance  levels 
(ind  degrees  of  performance  variability  within  and  between 
people  and  teams. 

10.  Personnel  Qualifications;  Personnel  qualifications 
Include  such  factors  as  skill  level,  experience,  and 
familiarity  with  the  task  to  be  performed. 

11.  Baseline  Data:  Zcjulpment  baseline  data  relates  to 


I 

I 

^ the  measures  of  personnel  performnce  on  current  systems 

and  subsystems.  This  data  Is  then  used  to  match  the 
I equipment  to  the  required  task. 

♦ 12.  Operating  Environment:  Operating  environmental  con- 

* sideratlons  Include  such  factors  as  temperature,  llluml- 

I nation, noise,  vibration,  motion,  and  space  limitations. 

Where  possible,  these  factors  are  related  to  a physio- 
logical criterion  such  as  hearing  loss,  visual  atten- 
uation. and  nausea. 

13.  External  Environment;  External  environmental  factors 
are  exogenous  to  the  task  being  performed  and  Include 
social,  political,  and  economic  considerations. 
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5.0  THE  INCLUSION  OF  HUMAN  FACTORS  IN  SYSTEM  DESIGN 


Now  that  the  design  methodology  has  been  briefly 
defined  and  the  human  resources  in  the  design  context 
have  been  both  defined  and  categorized,  the  task  of 
demonstrating  the  integration  of  human  factors  Into  the 
design  process  can  proceed.  Although  this  discussion 
deals  specifically  with  integration  of  human  factors, 
the  observation  is  made  that  the  following  methodology 
applies  to  the  more  generalized  problem  of  Insuring  the 
inclusion  of  any  relevant  factor  into  a design  or  planning 
probl em. 

5.1  APPLICATION  OF  FEASIBILITY  STUDY 

The  feasibility  study  was  defined  earlier  In  the 
context  of  the  design  methodology  (Para.  3.3.1)  and  now 
a specific  application  of  the  methodology  is  developed. 

For  this  purpose  it  is  assumed  that  a thorough  and  com- 
plete analysis  of  needs  has  been  accomplished,  and  the 
process  of  ■!  •''^nti fy i ng  and  formulating  the  problem  Is 
ur  urway.  The  i nput -oiitput  matrix  which  will  be  developed 
to  accomplish  this  'usk  will  of  course,  take  into  consi- 
deration all  relevant  factors  bearing  upon  the  sucre"'  ’ 
satisfaction  of  the  previously  defined  needs.  Even  for 
problems  of  limited  scope,  the  development  of  a complete 
input-output  matrix  can  become  an  extensive  process 


requiring  the  creativity  and  experience  of  experts  knowl- 
edgeable In  each  of  the  relevant  factors  Inherent  In  the 
specific  design  problem. 

The  Input-output  matrix  provides  a means  for  bound- 
ing the  design  problem  through  the  specific  Identification 
of  data  which  Is  necessary  to  describe  subjectively  the 
nature  of  the  design  space.  This  Is  accomplished  by  con- 
sidering each  of  the  phases  of  the  production-consumption 
cycle  and  Identifying  as  many  descriptors  as  practical 
In  a matrix,  as  shown  In  Figure  5.1.  This  data  must  be 
as  specific  and  exhaustive  as  Is  possible,  given  the  usual 
designer's  dilemma  of  Incomplete  or  Imperfect  knowledge 
In  the  arena  of  high  technology  design.  The  Implication, 
therefore,  Is  Implicit  that  as  additional  knowledge  re- 
levant to  the  design  problem  Is  Identified  It  should  be 
added  to  the  matrix.  The  matrix  Itself  Is  divided  Into 
four  categories  to  aid  In  organizing  the  data. 


Inputs  Cjtputs 


Intended 

Environmental 

Desired 

Undesired 

Production 

Distribution 

Consumption- 

Operation 

Retirement 

Figure  5.1  The  Input-Output  Matrix 
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An  effective  approach  to  the  matrix  Is  to  consider 
the  outputs  first.  In  general,  these  are  definitive 
descriptors  of  the  needs  of  the  respective  phases  of  the 
production-consumption  cycle  as  they  reflect  the  results 
of  a completed  and  successful  system  development.  Such 
descriptors  of  desirable  characteristics  describe  the 
"desired  output"  category.  However,  when  a system  Is 
developed  there  Is  Inevitably  associated  with  the  outcome 
some  undesirable  characteristics  which.  If  properly  antic- 
ipated. can  be  minimized  with  regard  to  their  effects 
on  the  outcome.  These  undesirable  descriptors  are  the 
"undesired  output"  category.  Care  should  be  taken, 
however,  to  avoid  listing  opposite  effect  descriptors 
as  they  do  not  contribute  meaningfully  to  the  solutions. 

"Environmental  Inputs"  are  those  characteristics  or 
tangibles  that  are  available  or  that  Influence  the  de- 
signer. They  constitute  the  existing  conditions,  fa- 
cilities, equipment,  and  personnel  that  are  Ingredients, 
and  they  contribute  to  producing  the  outputs.  Note 
that  "Influence"  does  not  necessarily  mean  a positive 
Influence:  It  could  detract  from  the  effort  to  achieve 
results. 

Once  the  environmental  Inputs  have  been  defined  for 
each  phase  of  the  production-consumption  cycle,  the 
final  matrix  category,  the  "Intended  Inputs,”  -in  be 


derived  by  answering  the  question:  "What  Is  needed  to 
supplement  the  environmental  Inputs  In  order  to  achieve 
the  outputs?"  When  this  has  been  applied  to  each  phase 
In  the  product1on>consumpt1on  cycle,  a good  list  of 
"start-up"  considerations  Is  available  for  the  system. 

The  Intended  Inputs  then  start  the  process  to  enable 
the  achievement  of  outputs. 

The  question  of  "adequacy"  of  an  Input-output  analysl 
will  vary  from  project  to  project  and  must  be  Judged  by 
the  designer.  The  characteristic  that  remains  consistent 

among  all  projects  Is  the  Inability  to  define  all  require 

• 

ments  to  a satisfactory  level  without  considerably  more 
Information  than  Is  normally  available  at  this  point  In 
the  project.  However,  It  Is  Important  to  the  designer 
that  each  cell  In  the  matrix  be  as  complete  as  possible. 
Doing  so  raises  questions  which  help  direct  attention 
to  the  nature  of  the  problems  to  be  solved  before  suc- 
cessfully meeting  the  requirements  of  that  particular 
cell  and.  this  sets  the  stage  for  future  decisions. 

The  Input-output  matrix  helps  to  bound  the  problem 
which  tends  to  direct  the  thinking  necessary  to  accom- 
plish requirements  of  the  defined  needs.  The  design 
process  now  shifts  to  a synthesizing  mode  requiring  the 
Identification  of  functions,  which  when  pieced  together, 
will  provide  a solution  tailored  to  the  need.  The 


synthesis  of  solutions  Involves  the  Identification  of 
candidate  systems  which  would  accomplish  every  function 
and  activity  related  to  the  total  system  If  the  candidate 
system  were  completely  developed.  The  designer  Is  charged 
with  the  task  of  synthesizing  a set  of  candidate  systems 
bearing  In  mind  that  the  larger  the  number  of  candidate 
systems  for  a given  set  of  criteria  and  constraints,  the 
greater  the  likelihood  of  emerging  with  the  "best”  pos- 
sible system  to  meet  the  defined  needs.  Before  proceeding 
with  preliminary  design  activities,  however,  an  examlna- 
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tion  of  this  set  of  candidates  must  be  made  to  assure 
that  these  potential  systems  will  be  feasible.  A screening 
of  candidate  systems  Is  necessary.  However,  "no  candi- 
date system  should  be  eliminated  during  the  feasibility 
study  unless  that  candidate  cannot  be  physically  assembled 
(for  a certainty)  and  cannot  meet  the  economic  a d finan- 
cial limitations  Imposed  by  the  Input-output  analysis  of 
the  problem  Identification  and  by  the  needs  analysis" 

[14,  page  55]. 

5.2  AN  INPUT-OUTPUT  MATRIX  FOR  AIR  FORCE  SYSTEM  DESIGN 

The  crux  of  the  problem  of  demonstrating  the  Inte- 
gration of  human  factors  Into  the  design  process  then 
Is  the  development  of  an  Input-output  matrix  relating 
to  Air  Force  needs.  The  Input-output  matrix  developed 
follows  the  production-consumption  cycle  which  was 
defined  by  the  design  morphology  and  which  was  earlier 


related  to  the  Air  Force  system  life  cycle  phases.  This 
provides  continuity  and  consistency  with  Air  Force  design 
philosophy.  However*  these  four  phases  (I.e.,  production, 
distribution,  operations,  and  retirement]  provide  a very 
coarse  division  of  the  matrix  and  provide  a severe  limi- 
tation on  Its  practical  usefulness  and  manageabll Ity. 
Therefore,  a further  division  of  each  phase  has  been  de- 
veloped to  Identify  the  key  elements  of  each  phase  of  the 
system  life  cycle  (Figures  5.2,  5.3,  5.4,  5.5)  The  elements 
vary  from  phase  to  phase  and  are  tailored  to  the  objectives 
of  the  particular  phase.  These  elements  are  specifically 
defined  In  terms  of  the  phase  with  which  they  are  associ- 
ated. For  a definition  of  the  elements  by  phase,  see 
Appendix  A. 

5.3  ILLUSTRATED  INPUT-OUTPUT  MATRIX  - DEMONSTRATING  THE 

INCLUSION  OF  HUMAN  FACTORS  IN  SYSTEM  DESIGN 

The  demonstration  of  the  application  of  an  Input- 
output  matrix  Is  limited  to  establish  realistic  bounds 
upon  the  scope  of  this  discussion.  The  demonstration 
has  been  restricted  to  the  development  of  one  element 
from  each  phase  of  the  matrix.  In  addition,  the  develop- 
ment of  the  Input-output  matrix  will  be  generalized, 
that  Is,  a specific  system  will  not  be  modeled,  but  the 
matrix  will  rather  demonstrate  the  Inclusion  of  design 
factors  (descriptors]  typically  relevant  to  aerospace 
system  design. 
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Figure  5.2  Input-Output  Matrix  for  Aerospace  System  Design  - Production 


Figure  5.4  Input-Output  Matrix  for  Aerospace  System  Design  - Operations 


SAFETY 

MANAGEMENT  INFORMATION 
ENVIRONMENTAL 


Because  a concomitant  problem  of  Including  human 
factors  In  design  has  consistently  been  one  of  the  avail- 
ability of  a human  factors  data  base  [7],  an  attempt  has 
been  made  to  reference  the  descriptors  of  the  matrix 
which  relate  to  human  factors  to  the  previously  mentioned 
human  factors/design  bibliography  [15].  This  demonstrates 
the  flexibility  of  the  matrix  as  a tool  of  the  designer 
to  Interface  with  a relevant  data  dase.  The  cross- 
referencing  of  the  matrix  with  the  data  base  Is  accomplished 
through  the  footnoting  of  the  appropriate  descriptor  In 
a manner  which  corresponds  to  a reference  or  group  of 
references  In  the  data  base. 

Appendix  B Is  an  adaptation  of  the  previously  re- 
ported bibliography  on  the  morphology  of  design  with 
the  Inclusion  of  human  factors  [15].  The  appendix 
Illustrates  a data  base  of  human  factors  literature  of 
Interest  to  systems  designers.  It  represents  an  Ini- 
tial effort  aimed  at  demonstrating  the  feasibility  of 
bridging  the  communications  gap  between  the  systems 
design  engineer  and  the  human  factors  specialist.  This 
effort  is  limited  to  the  extent  necessary  to  accomplish 
this  goal.  A data  base  In  some  form  Is  necessary  If  the 
design  engineer  is  to  Include  relevant  criteria  Into  the 
design  analysis  to  Insure  adequate  consideration  of  the 
Inclusion  of  human  factors  In  system  design. 


The  demonstration  data  base  use^  the  previously  de> 
fined  thirteen  human  factors  categories  isee  Para.  4.3) 
to  catalog  the  human  factors  references  from  the  bibliog- 
raphy. The  Individual  references  which  pertain  to  human 
factors  are  sorted  with  regard  to  the  human  factor  cate- 
gory or  categories  to  which  they  refer.  The  thirteen 
groups  of  references  are  then  numbered  to  facilitate 
access.  For  example,  a reference  number  of  7.0  refers 
to  all  the  references  listed  In  human  factors  category 
number  seven  (Man-Machine  Interface),  while  a reference 
number  of  7.2  refers  specifically  to  article  number  two 
(2)  In  category  number  seven  (7).  Multiple  footnoting 
utilizing  these  reference  numbers  are  often  required  to 
adequately  relate  a particular  matrix  descriptor  to  the 
data  base. 

Figures  5.6.  5.7.  5.8.  and  5.9  are  the  Illustrated 
Input-output  matrices.  It  can  be  readily  seen  from 
these  generalized  examples  that  the  completion  of  a full 
set  of  matrices  for  an  actual  system  under  development 
Is  a formidable  task.  But  the  payoffs,  both  In  terms  of 
optima!  system  performance  and  system  life  cycle  costs, 
more  than  Justify  the  effort.  A criterion,  once  Identi- 
fied. can  be  readily  Included  In  the  design  analysis. 

But  of  greater  Importance  during  the  Initial  stages  of 
system  design  Is  the  Identification  of  those  factors 
which  are  the  unknowns  or  unquantified  factors  which 
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must  be  resolved  before  the  system  design  problem  can 
be  successfully  solved 
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6.0  CLARIFICATION  OF  OBJECTIVE  AND  SUBJECTIVE 
INPUTS  TO  DESIGN  DECISIONS 


During  the  development  of  a system  It  becomes  very 
apparent  that  objectivity  Is  necessary  to  the  achievement 
of  effectiveness.  The  need  to  evaluate  and  to  compare 
performance  of  ilternatives  requires  in-depth  consider- 
ation of  the  many  facets  of  the  design,  usually  In 
such  a way  that  trade-offs  between  subjective  ana  ob- 
jective requirements  become  necessary.  For  example,  It 
Is  well  known  that  air  crew  comfort  must  be  considered 
In  the  development  of  an  aircraft  In  order  to  achieve 
efficient  crew  performance.  Lack  of  environmental 
comfort  for  a pilot  Is  a major  contributor  to  fatigue 
and  other  undesirable  traits  that  lead  to  rapid  deterio- 
ration of  pilot  judgement  - a vital  Input  to  mission 
effectiveness.  Consequently  the  designer  Is  faced  with 
the  problem  of  clearly  Identifying  the  system's  needs  in 
such  a way  that  the  Important  characteristics  of  the 
candidate  systems  are  consistently  related  to  the  cri- 
teria defined.  In  the  Identification  of  these  character- 
istics the  assessment  of  many  areas  will  require  esti- 
mating the  effects  of  relatively  subjective  Inputs. 

When  the  decision  Is  made  that  this  measurement  Is 
Important  enough  to  spend  resources  on  the  problem, 


then  models  are  constructed  to  estimate  the  values  and 


testing  occurs  to  verify  relationships. 


Hence,  It  becomes  apparent  that  the  designer  has  a 
requirement  to  clearly  Identify  the  subjective  and 
objective  Inputs  to  his  decisions,  particularly  In  the 
choice  of  the  optimal  candidate  system.  Figure  3.5 
Is  an  attempt  to  have  the  designer  Identify  those 
elements  that  contribute  to  the  meaning  or  to  the  measure 
ment  of  each  criterion.  Here  the  designer  lists  any 
attribute  or  characteristic  (whether  subjective  or 
objective)  that  Is  Important  to  the  estimation  of  that 
criterion  In  a quantitative  manner.  In  subsequently 
attempting  to  synthesize  mathematical  formulations  for 
the  criterion,  the  designer  comes  to  grips  with  the 
problems  of  evaluation  of  these  elements.  Criterion 
elements  that  are  readily  measured  or  estimated  present 
little  difficulty  to  the  designer,  and  classically, 
these  form  the  larger  proportion  of  the  technical  con- 
stituency of  USAF  systems.  Those  elements  that  are 
subjective,  however,  provide  the  designer  with  the 
following  dilemma.  Are  they  of  sufficient  Importance  to 
Include  In  the  evaluation  of  the  criterion  along  with 
the  objective  Input?  If  they  are,  then  methods  must  be 
devised  for: 

1)  estimating  their  effects  In  a manner  comparable 
to  the  more  objective  Inputs,  and 


2)  including  the  resulting  effects  In  a criterion 
function  Vih^rh  can  be  Integrated  Into  a mul- 
tiple criteri.,  1 function  (I.e.  criteria  function). 

If  these  are  not  of  sufficient  Importance,  then  their 
effects  are  used  to  assess  performance  of  the  optimal 
candidate  system  after  It  has  been  defined,  usually  having 
little  or  no  influence  on  Its  choice. 

While  the  effects  of  modeling  subjective  elements 
of  the  criteria  are  clearly  observed,  there  are  similar 
considerations  occurring  throughout  the  entire  morphology. 
In  general  the  subjectivity  Is  included  more  readily 
during  the  needs  analysis,  problem  Identification,  syn- 
thesis of  solutions,  and  the  screening  activities  since 
the  designer  has  the  basic  problem  of  establishing  as 
large  a base  of  candidate  systems  as  possible.  Hence, 
the  subjectivity  (and  to  some  extent  the  objectivity) 
act  as  guidelines  for  the  development  of  the  candidate 
systems  that  will  emerge  from  the  feasibility  study. 

During  the  preliminary  activities  the  designer  comes 
to  grips  with  the  subjectivity  by  making  explicit  (In 
the  form  of  a criteria  function)  those  submodels  and 
parameters  to  be  Included  In  the  formal  optimization. 

It  Is  here,  then,  that  the  critical  decisions  are  made 
in  the  overall  design  of  the  system,  and  hence.  It  Is 


here  In  the  preliminary  activities  that  the  "soft"  areas 
contributing  to  the  design  criteria  must  be  Included. 

The  problems  of  Inclusion  are  those  that  have  been  avoided 
to  a large  extent  by  designers  since  these  problems  usually 
Involve  the  activities  furthest  removed  from  what  Is 
considered  as  the  "mainstream"  of  the  equipment  design 
and  development.  Consequently,  major  contributions  to 
the  effective  Inclusion  of  subjective  (and  other  "soft") 
Inputs  can  be  made  by  Identifying  procedures  (and  even 
algorithms  In  some  cases)  for  the  estimation  of  the  ef- 
fects of  these  elements.  In  many  cases,  the  effects  of 
human  factors  are  considered  "subjective"  by  equipment 
designers  and  hence,  have  the  difficulties  described 
herein,  and  can  be  approached  effectively  as  described 
above. 

The  development  of  the  plans  that  constitute  the 
detail  activities  Include  the  entire  spectrum  of  con- 
siderations provided  by  the  knowledge  In  the  disciplines 
relating  to  a given  system.  Included  In  all  major  USAF 
systems  are  those  subsumed  along  with  other  areas  of 
system  support.  Several  major  USAF  attempts  to  Inte- 
grate these  disciplines  have  occurred  In  the  past  few 
decades  (I.e.  System  Engineering  and  System  Management 
documentation),  but  In  almost  every  case,  true  Integration 
of  human  factors  occurred  where  the  need  was  clearly 
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shown  from  recent  history,  and  where  clear  procedures 
were  defined. 

More  recently  DOO  Implemented  procedures  for  Inte- 
grating logistics  support  during  the  entire  life  cycle 
of  a system.  While  philosophically  accurate,  the  pro- 
blems of  procurement  and  practice  often  eliminated  the 
advantages  to  USAF  of  an  Integrated  support  system. 
Consequently,  the  political  and  economic  ramifications 
become  crucial  to  the  acceptance  of  any  methods  put 
forth  to  enhance  system  development.  This  Is  a clear 
Indication  that  In  some  cases  these  “soft”  areas  should 
be  modeled  for  their  effects  on  the  criteria  function. 

Ccfnsequently , an  attempt  should  be  made  to  develop 
several  criterion  functions  showing  the  inclusion  of 
human  factors  elements  along  with  the  disciplinary 
Inputs  Into  the  emerging  function.  The  method  shown 
In  the  text  [14,  Appendix  C]  provides  the  mathematical 
logic  for  the  development. 


7.0  CONCLUSIONS 


This  research  has  achieve*  Its  stated  purpose  of 
clarifying  a design  morphology  which  Is  applicable  to 
large  scale  systems  In  general,  and  to  USAF  systems  In 
particular,  while  demonstrating  the  Inclusion  of  human 
factors  In  system  design.  The  specific  conclusions 
which  have  been  Identified  are  discussed  below. 

7.1  APPLICABILITY  OF  DESIGN  MORPHOLOGY  TO  AEROSPACE 

SYSTEMS 

The  design  morphology  described  herein  Is  applicable 
to  aerospace  systems  and  Is  compatible  with  the  life 
cycle  phases  currently  used  by  DOD.  A direct  comparison 
between  the  USAF  life  cycle  and  that  of  th*  design  mor- 
phclv?gy  Indicated  a one-to-one  correspondence  between 
the  phases-  Moreover,  the  design  morphology  represents 
; comprehensive  philosophy  for  system  design  and  Is 
tnerrfore  applicable  to  a full  range  of  design  problems 
Including  large  scale  aerospace  systems. 

7.2  VALUE  OF  DESIGN  MORPHOLOGY 

The  design  morphology  provides  an  orderly  and  ra- 
tional sequence  of  decisions  requiring  resolution  to 
design  and  develop  the  optimal  system  for  DOD  requirements 
or  other  defined  needs.  The  three  design  phases  - feasi- 
bility study,  preliminary  design,  and  detail  design  - 


consist  of  a number  of  sequential  activities  which  ensure 
a complete  and  thorough  approach  to  the  solution  of  the 
problem. 

7.3  COMMUNICATION  BETWEEN  DESIGNERS  AND  HUMAN  FACTORS 
SPECIALISTS 

There  appears  to  be  a s1gn1f1c;»rt  co  *mun1cat1on  pro- 
blem between  the  DOD  equlr'  ...  design  community  and  the 
human  factors  specialists  (as  demonstrated  by  the  ref- 
erences) although  there  Is  general  agreement  on  th<* 
necessity  for  their  corroboration.  The  corroboration 
of  psychologist  and  engineer  Is  a continuing  proces'. 
within  a given  system  design  program.  The  proper  In- 
clusion of  human  factors  Into  the  system  design  Is 
dependent  upon  the  availability  of  relevant  quantl- 

I 

flable  data  as  an  Input  to  the  decision  process. 

I 

7.4  THREE  DIMENSIONAL  MATRIX 

The  concept  of  a three  dimensional  relationship 
among  human  factors,  the  design  steps,  and  the  current 
literature  Is  an  effective  approach  to  the  solution  of 
the  problem  of  human  factors  Inclusion  Into  the  design 
morphology.  The  translation  of  this  relationship  to 
a conceptualized  matrix  provides  a rational  and  straight- 
forward method  for  the  complete  Identification  of  rele- 
vant human  factors  and  for  their  Inclusion  Into  the 
design  process. 


7.5  HUMAN  FACTORS  IDENTIFICATION  AND  CLASSIFICATION 


Additional  effort  Is  required  to  Identify  and 
classify  the  human  factors  relevant  to  the  design  of 
aerospace  systems.  For  the  purpose  sf  the  Inclusion 
of  human  factors  data  Into  the  design  process  a system 
of  human  factors  catec^'t  ies  was  found  to  be  necessary 
to  provide  a ••ef^  -nee  for  the  collection  of  relevant 
data  peiLf^ent  to  anticipated  design  problems.  Such 
a sys.em  of  categories  was  devised  and  Its  use  Il- 
lustrated. 

7.6  HUMAN  FACTORS  REFERENCE  BASE 

An  effort  should  be  Initiated  to  maintain  a complete 
human  factors  reference  base  along  the  lines  Illustrated 
by  Appendix  B.  The  data  base  should  be  standardized, 
validated,  and  made  available  to  DOD  agencies  and  con- 
tractors. Moreover,  the  data  base  must,  to  the  maxi- 
mum extent  possible,  represent  quantified  empirical 
data  which  should  be  standardized  to  facilitate  engi- 
neering useage. 

7.7  INPUT-OUTPUT  MATRIX 

The  Input-output  matrix  provides  a means  for  bounding 
the  design  problem  through  the  specific  Identification 
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of  characteristics  which  are  necessary  to  describe 
the  nature  of  the  design  space.  By  bounding  the  design 
problem  the  Input-output  matrix  helps  to  direct  the 
analysis  necessary  to  accomplish  requirements  of  the 
defined ‘needs.  The  Importance  of  this  approach  war- 
rants further  study  of  the  matrix  and  its  phase  ele- 
ments In  the  context  of  aerospace  system  design. 

7.8  SUBJECTIVE  DESIGN  INPUTS 

The  need  for  defining  means  for  estimating  the 
effects  of  human  factors  and  other  subjective  Inputs 
on  the  design  optimization  process  was  reinforced  by 
this  research.  It  was  shown  that  these  subjective 
Inputs  should  be  modeled  for  their  effects  on  the  cri- 
teria function.  Therefore  an  attempt  should  be  made  to 
estimate  their  effects  In  a manner  comparable  to  the 
more  objective  Inputs. 


8.0  DEFINITION  OF  POTENTIAL  AREAS 
FOR  FUTURE  INVESTIGATION 


The  research  for  fiscal  year  1978  is  planned  to 

augment  the  current  activities  by  pursuing  in  add1> 

tional  depth  the  design  morphology  with  emphasis  on 

★ 

human  factors.  For  the  coming  year,  an  illustrative 
hardware  system  will  be  selected  and  attempts  made 
to  develop  the  input-output  matrix,  identify  formal 
system  criterin,  estimate  the  significance  of  criterion 
interactions,  develop  cri teri a-parameter  relationships 
and  structure  a criteria  function.  While  this  research 
clarifies  the  basic  design  methodology,  there  were 
several  areas  that  emerged  from  the  current  research 
that  appear  to  justify  further  investigation.  These 
are  suggested  below. 

8.1  CONTINUED  DEVELOPMENT  OF  RELATIONSHIPS  AMONG 
HUMAN  FACTORS,  DESIGN  MORPHOLOGY,  AND  THE 
EXISTING  LITERATURE 

The  current  research  established  the  beginnings  of 
a formal  three  dimensional  relationship  among  human 
factors,  the  steps  in  the  design  morphology,  and  the 
existing  literature.  This  was  accomplished  by  formally 
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defining  the  major  (or  basic)  categories  of  human  factors 
as  they  related  to  each  step  In  the  design  morphology. 
Then  each  major  publication  In  the  current  literature  as 
shown  In  this  research  [15]  was  related  to  the  respective 
human  factors-design  step  pair.  The  volume  of  effort 
required  to  complete  this  research  was  beyond  the  scope 
of  the  resources  provided,  hence  this  should  ti  con- 
tinued In  order  to  provide  more  complete  coverage  for 
future  research  and  application. 

8.2  STUDY  OF  CURRENT  OOD/USAF  POLICY  FOR  DESIGN  OF 
TECHNOLOGICAL  SYSTEMS  FOR  POTENTIAL  MODIFICATION 
70  ENHANCE  INCLUSION  OF  HUMAN  FACTORS  FROM  MOR- 
PHOLOGICAL CONSIDERATIONS 

000  has  a proliferation  of  systems  engineering/sys- 
tems management  documentation  Including  regulations,  cir- 
culars, specifications,  standards,  etc.  which  require 
specific  actions  to  assure  compliance  by  the  developing 
organization.  These  should  be  reviewed  to  assure  USAF  1 

I 

of  an  efficient  compendium  of  requirements,  and  to  ascer-t 
tain  that  all  decisions  made  relative  to  hardware  and/or  « 
system  development  efficiently  relate  to  human  capa- 
bilities. The  design  morphology  provides  an  excellent 
standard  by  which  to  assure  the  Inclusion  of  all  major 
development  decisions. 


8.3  SUPPLEMENTARY  ANALYTICAL  THEORY  DEVELOPMErr 

The  development  of  criteria,  submodels,  and  para- 
meters, as  Indicated  lead  to  a multidimensional  space 
referred  to  variously  as  a "hyperspace,"  "design  space," 
and  "multivariate  space.”  While  the  conceptual  theory 
for  the  structure  of  this  space  is  relatively  complete, 
there  exists  certain  practical  aspects  which  merit  devel- 
opment In  addition  to  the  resources  currently  provided. 
Such  problems  as  mapping  a polynomial  into  a probability 
space,  multivariate  goodness-of-f i t tests,  elaboration 
of  the  parametric  relationships  resulting  from  the  mul- 
tivariate Interactions,  and  many  more  should  be  developed 
Clarification  of  these  areas  could  have  significant  in- 
fluence on  Improvement  of  reliability/maintainability 
engineering,  as  well  as  the  more  classical  problem  of 
system  development.  More  Importantly,  however,  these 
areas  will  permit  more  readily  acceptable  means  for 
Integrating  human  factor  decisions  into  the  design  pro- 
cess, particularly  in  the  system  optimization  decisions. 

8.4  CONTINUE  DEVELOPMENT  OF  INPUT-OUTPUT  MATRIX 

Effort  should  be  devoted  to  continue  the  develop- 
ment of  the  Input-output  matrix  for  all  elements  of 
the  production  consumption  cycle.  This  work  would 
provide  a source  of  Information  to  the  USAF  designer 


for  completeness  of  planning  considerations. 

8.5  DATA  BASE  DEVELOPMENT  FOR  HUNAN  FACTORS 

Additional  study  should  be  made  to  assure  Inclusion 
of  human  factors  metrics  Into  a generalized  data  base. 
This  activity  will  Identify  classes  of  data  elements 
necessary  to  the  validation  of  human  factor  adequacy. 
Identifying  specific  elements  of  each  class.  The  data 
elements  must,  to  the  maximum  extent  possible,  represent 
quantified  empirical  data  translated  Into  a standardized 
data  format.  The  level  of  effort  required  for  human 
factors  data  base  development  Is  beyond  the  scope  of  the 
resources  provided.  However,  the  long  term  solution  to 
the  problem  of  the  proper  Inclusion  of  human  factors  in 
system  design  will  Inevitably  return  to  the  availability 
of  human  factors  metrics,  hence  further  research  Is 
necessary. 

8.6  CONTINUED  DEVELOPMENT  OF  THE  DESIGN/HUMAN  FACTORS 
REFERENCES 

The  work  Illustrated  In  Appendix  B should  be  con- 
tinued to  provide  a more  complete  design  reference  list 
for  each  given  human  factor.  Further  specific  attempts 
should  be  made  to  identify  data  elements  of  Interest  to 
a given  class  of  equipment  for  each  human  factor  In  a 
given  stage  of  the  design  morphology. 
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APPENDIX  A 


DEFINITIONS  OF  ELEMENTS 


This  appendix  provides  working  definitions  for  the 
elements  of  the  Individual  life  cycle  phases  of  the  Input- 
output  matrix  for  Air  Force  system  design. 


PHASE 


ELEMENTS 


PAGE 


PRODUCTION 


Production  Planning  A-3 
Production  Control  A-3 
Supply  Support  A-3 
Costs  A-3 
Facilities  A-4 
Test  and  Support  Equipment  A-4 
Rel labll 1ty/Mainta1nab111ty/Ava11ab11 Ity  A-4 
Organization  Plan  A-5 
Personnel  and  Training  A-5 
Transportation  and  Handling  A-5 
Technical  Data  A-5 
Testing  A-5 
Quality  Assurance  A-5 
Management  Information  A-6 
Environmental  A-6 


DISTRIBUTION 

Distribution  Planning  A-7 
Costs  A-7 
Organization  Plan  A-7 
Personnel  and  Training  A-7 
Transportation  and  Handling  A-7 
User's  Training  A-8 
Management  Information  A-8 


PHASE  ELEMENTS  PAGE 


OPERATIONS 

Operations  Planning  A-9 

Performance  A-9 

Supply  Support  A-9 

Maintenance  Planning  A-9 

Costs  A-10 

Facilities  A-10 

Test  and  Support  Equipment  A-10 

Rel labi 1 1 ty/MaIntalnabI 1 1 ty/Aval labi 1 1 ty  A-10 
Organization  Plan  A-11 

Personnel  and  Training  A-11 

Technical  Data  A-11 

Safety  A-11 

Management  Information  A-11 

Environmental  A-11 

RETIREMENT 

Future  Oemand  A-12 

Supply  Support  A-12 

Maintenance  Planning  A-12 

Costs  A-12 

Facilities  A-13 

Test  and  Support  Equipment  A-13 

Organization  Plan  A-13 

Personnel  and  Training  A-13 

Transportation  and  Handling  A-13 

Safety  A-13 

Management  Information  A-14 

Environmental  A-14 


A-2 


PRODUCTION  PHASE 


ELEMENTS: 

PRODUCTION  PLANNING 
PRODUCTION  CONTROL 
SUPPLY  SUPPORT 
COSTS 

FACILITIES 

TEST  AND  SUPPORT  EQUIPMENT 
■ RELIAaiLITY/MAINTAINABILITY/ AVAILABILITY 
ORGANIZATION  PLAN 
PERSONNEL  AND  TRAINING 
TRANSPORTATION  AND  HANDLING 
TECHNICAL  DATA 
TESTING 

QUALITY  ASSURANCE 
MANAGEMENT  INFORMATION 
ENVIRONMENTAL 

PRODUCTION  PLANNING; 

The  major  considerations  in  production  planning  Include  the 
type  of  production  (continuous  versus  intermittent),  the 
plant  layout,  the  sequence  of  assembly,  the  production  rate, 
the  use  of  hiring,  firing,  and  overtime,  the  inventory  levels, 
and  the  scheduling  of  the  production  activities. 

PRODUCTION  CONTROL: 

Production  control  consists  of  a control  plan  which  adjusts 
production  and  Inventory  levels,  a feedback  system  which 
allows  for  correction  of  errors,  and  the  use  or  network 
scheduling  techniques  to  monitor  the  critical  activities. 

SUPPLY  SUPPORT: 

Supply  support  for  the  production  process  consists  of  all 
raw  materials  and  components  (units,  assemblies,  modules, 
etc.),  repair  parts,  consumables,  special  supplies  and 
related  inventories  needed  to  produce  a finished  product, 
test  and  support  equipment,  facilities,  and  training 
equipment.  Considerations  include  each  production  level 
and  each  location  where  conponent  parts  are  distributed  and 
stocked,  the  distances  between  stockage  points,  and  the 
methods  of  material  distribution  [6,  pagr.  8]. 

COSTS: 


The  cost  analysis  involves  the  costs  of  production  as  well 
as  those  of  all  the  elements  considered  in  the  production 


phase.  The  definition  of  cost  categroles  should  be  con> 
sistent  with  the  requirements  of  the  USAF  and  the  ability  to 
evaluate  system  performance  against  cri terla  resulting  from 
system  requirements. 


FACILITIES: 

Production  facilities  Include  the  physical  plant,  real 
estate*  temporary  structures,  housing.  Intermediate  shops, 
depots,  etc.  requrled  to  support  manufacturing  and  produc- 
tion testing  of  the  system,  storage  for  materials  and  sub- 
assembly  components,  and  training  operations.  Capital 
equipment  and  utilities  (heat  power,  air  conditioning, 
telephone,  etc.)  are  considered  as  part  of  facilities 
[6.  page  9]. 

TEST  AND  SUPPORT  EQUIPMENT: 

Test  and  support  equipment  used  In  production  Includes  all 
tools,  monitoring  and  checkout  equipment,  metrology  and 
clalbratlon  equipment,  work  stands  and  handling  equipment 
required  to  support  production  activities  associated  with 
the  system.  This  covers  external  test  equipment  and  built- 
in  test  (BIT)  equipment  which  Is  considered  to  be  part  of 
the  system.  Test  and  support  equipment  can  be  classified 
as  "recullar*'  (newly  designed  and/or  off-the-shelf  Items 
peculiar  to  the  system  und'sr  development)  or  "standard" 
(existing  Items  already  In  the  Inventory). 

RELIABILITY/MAINTAINABILITY/AVAILABILITY: 


These  three  concepts  In  the  production  phase  relate  to  the 
production  equipment  as  well  as  the  support  and  test  equip- 
ment. Reliability  Is  the  ability  to  perform  the  Intended 
functions  In  the  Intended  environment  for  as  long  as  planned. 
This  Is  often  modeled  by  a probability  density  to  estimate 
the  probability  of  a failure.  Numerical  reliability  require- 
ments are  derived  on  theoretical  grounds  by  considering  the 
performance  requirements  as  well  as  the  characteristics  of 
the  Interfacing  systems.  Moreover,  reliability  performance 
predictions  must  be  apportioned  to  the  constituent  elements 
within  the  system  [14,  page  176].  Maintainability  Is  the 
ability  of  the  system  to  be  maintained  In  Its  Intended 
environment.  It  Is  defined  as  the  probability  that  a 
failed  system  Is  restored  ^o  operable  condition  In  a spe- 
cified environment.  Maintainability  analysis  translates 
maintenance  planning  Into  detailed  quantitative  and  quali- 
tative requirements  and  affects  the  related  elements  for 
maintaining  the  system  by  estimating  the  Hkllhood  of 
task  accomplishment  In  the  rperatlonal  environment.  It 
Involves  the  allocation  of  the  quantitative  requrlements  to 
all  levels  of  the  system  [14,  page  170].  Availability  Is  an 


attribute  that  Is  a function  of  both  reliability  and  main- 
tainability, and  a major  factor  In  the  planning  for  number 
of  required  units  to  accomp'  jh  operational  goals 
[14,  page  180]. 

ORGANIZATIOh  PLAN; 

The  organization  plan  for  production  develops  an  organi- 
zational structure  for  the  accomplishment  of  the  tasks 
required  during  the  production  pahse  and  the  activities 
required  to  achieve  this  organization  In  a timely  manner. 

PERSONNEL  AND  TRAINING: 

Personnel  and  tral'-lng  cons1d.irat1ons  for  production  In- 
clude the  Identification  and  programming  of  skills,  number 
of  people,  and  training  needed  to  accomplish  the  activities 
of  the  production  phase  [14,  page  228]. 

TRANSPORTATION  AND  HANDLING; 

The  transportation  and  handling  needs  of  the  production 
phase  Include  special  provisions,  reusable  containers,  and 
supplies  necessary  to  support  packaging,  preservation, 
storage,  handling,  and/or  transportation  of  the  primary 
system  Itself,  Its  test  and  support  equipment,  components 
and  subassemblies,  personnel,  techrical  data,  and  facilities 
[6,  page  9]. 

TECHNICAL  DATA; 

Technical  data  util Ized  In  production  Includes  drawings, 
microfilm,  operating  and  maintenance  Instructions,  modi- 
fication Instructions,  provisioning  and  facilities  Infor- 
mation, specifications.  Inspection  and  calibration  procedures 
and  computer  software  required  to  support  Installation  and 
checkout  of  the  system  and  associated  test  and  support 
equipment  [6,  page  9]. 

TESTING: 

Production  testing  consists  of  a sampling  plan  wherein  the 
test  verifies  some  particular  physical  characteristics  of 
performance.  The  purpose  Is  to  verify  compatibility  among 
the  constituent  components  as  well  as  adequate  technical 
performance  [14,  page  151]. 

QUALITY  ASSURANCE: 

Production  quality  assurance  relates  to  the  establishment 
of  a standard  of  performance  for  a production  process  to 
provide  the  desired  level  of  quality  for  the  system. 
Statistical  quality  assurance  consists  of  both  process 


control  sampling  and  product  acceptance  sampling. 

HAflAGEHEN T INFORMATION : 

The  management  of  production  Information  consists  of 
assembling  data  Into  a manageable  aggregate  for  evaluation. 
It  provloos  the  feedback  to  the  designer  and  to  the  pro- 
ducer as  v^ell  as  to  the  user  rrem  the  system  concerning 
conditions  about  the  state  of  production  activities.  It 
also  usually  requires  some  formatting  and  analysis 
[14,  page  232]. 

ENVIROMMENTAL: 

Environme.ital  considerations  In  the  production  phase  in- 
clude Inputs  such  as  social  systems  and  available  tech- 
nologies, as  well  as  outputs  such  as  the  product  and 
production  facilities,  equipment,  and  personnel,  the  eco- 
nomic Impacts,  and  the  noneconomic  effects  [13,  Chapter  12], 


DISTRIBUTION  PHASE 


ELEMENTS: 

DISTRIBUTION  PLANNING 
COSTS 

ORGANIZATION  PLAN 
PERSONNEL  AND  TRAINING 
TRANSPORTATION  AND  HANDLING 
USER'S  TRAINING 
MANAGEMENT  INFORMATION 

DISTRIBUTION  PLANNING: 

Distribution  planning  describes  the  activities  for  the 
adequate  transfer  of  the  system  to  the  ultimate  operator 
or  consumer.  It  Includes  the  various  tyoes  of  facilities, 
equipment,  packaging,  warehousing,  promotional  activities, 
shelf  life,  organiz  tion,  and  Individuals. 

COSTS: 

The  cost  analysis  Involves  the  direct  and  Indirect  costs 
of  distribution  as  well  as  those  of  all  the  elements  con> 
sidered  In  the  distribution  phase.  As  In  production,  the 
definition  of  cost  categories  should  be  consistent  with 
the  requirements  of  USAF  and  the  ability  to  evaluate 
system  performance  against  criteria  resulting  from  system 
requirements. 

ORGANIZATION  PLAN: 

The  organization  plan  for  distribution  develops  an  organi- 
zational structure  for  the  accomplishment  of  the  tasks 
required  during  the  distribution  phase. 

PERSONNEL  AND  TRAINING; 

Personnel  and  training  considerations  for  distribution  In- 
clude the  Identification  and  programming  of  skills,  number 
of  people,  and  training  needed  to  accomplish  the  activities 
of  the  distribution  phase  [14,  page  228J. 

TRANSPORTATION  AND  HANDLING; 

The  transportation  and  handling  needs  of  the  distribution 
phase  Include  special  provisions,  reusable  containers, 
and  supplies  necessary  to  support  packaging,  preservation, 
storage,  handling  and/or  transportation  of  the  primary 
system,  test  and  support  equipment,  spare/repair  parts, 
personnel,  technical  data,  and  facilities  [6,  page  9]. 
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USER  TRAINING; 


User  training  Is  an  Important  consideration  In  the  distrl* 
butlon  phase.  It  InvoWes  getting  the  user  familiar  with 
the  technical  data,  the  operation  of  the  system,  mainte- 
nance Instructions,  conducting  training  seminars,  and 
clearly  defining  the  critical  logistics  activities. 

HARA6EHENT  IWFORHATIOW: 

The  management  of  Information  related  to  distribution 
consists  of  assembling  data  Into  a manageable  aggregate 
for  user  evaluation.  It  provides  the  feedback  to  the 
designer  as  well  as  to  the  user  pf  the  system  concerning 
conditions  about  the  state  of  distribution  activities. 
Also.  It  usually  requires  some  formatting  and  analysis 
[14.  page  232]. 


OPERATIONS  PHASE 
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ELEMENTS: 

OPERATIONS  PLANNING 
PERFORMANCE 
SUPPLY  SUPPORT 
MAINTENANCE  PALNNING 
COSTS 

FACILITIES 

TEST  AND  SUPPORT  EQUIPMENT 
RELIABILITY/MAINTAINABILITY/AVAI LABILITY 

organization  plan 

PERSONNEL  AND  TRAINING 
TECHNICAL  DATA 
SAFETY 

MANAGEMENT  INFORMATION 
ENVIRONMENTAL 

OPERATIONS  PLANNING; 

Operations  planning  consists  of  the  planning  to  accomplish 
on  a timely  basis  all  the  basic  elements  of  the  operations 
phase.  The  planning  should  include  the  entire  time  spectrum 
of  the  system  operating  life  and  may  be  divided  into  long- 
range,  intermediate-range,  and  short-range  planning,  usually 
involving  feedback  and  control  to  sustain  the  required  level 
of  performance. 

PERFORMANCE: 

The  performance  of  a system  is  measured  by  its  ability  to 
meet  operational  criteria  and  operational  demands  or  needs 
within  a given  time  when  operated  under  specified  conditions. 

SUPPLY  SUPPORT: 

The  supply  support  for  operations  consists  of  the  planning 
and  activity  to  provide  and  sustain  all  repairable  spares 
(units,  assemblies,  modules,  etc.),  repair  parts,  consumables, 
special  supplies  and  related  inventories  needed  to  support 
scheduled  and  unscheduled  maintenance  actions  associated 
with  the  operation  of  the  prime  equipment,  test  and  support 
■equipment,  facilities  and  training  equipment.  Considerations 
Include  each  maintenance  level  and  each  geographical  loca- 
tion where  spare/repair  parts  are  distributed  and  stocked, 
the  distances  between  stockage  points,  and  the  methods  of 
material  distribution  [6,  page  8]. 

MAINTENANCE  PLANNING; 

Maintenance  planning  for  operations  is  the  activity  that 
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Idtntifles  tht  support  requ1rt«ents  ond  p1«ns  for  nalntenince 
In  ordtr  to  satisfy  operational  goals.  Concepts  and  require* 
Kents  Cor  each  level  of  equipment  Maintenance  to  be  performed 
are  established.  A maintenance  engineering  analysis  Is 
usually  accompi Ished  during  concept  formulation  and  provides 
the  basis  for  adequacy  of  maintenance  planning  during  oper* 
atlons  [14.  page  224]. 

COSTS: 

The  cost  analysis  Involves  direct  and  Indirect  costs  of 
the  operations  as  veil  as  those  of  all  the  elements  con- 
sidered In  the  operations  phase.  As  In  earlier  phases, 
the  definition  of  cost  categories  should  be  consistent  with 
the  requirement  of  USAF  and  the  ability  to  evaluate  system 
performance  against  criteria  resulting  from  system  re- 
quirements. 

FACILITIES: 

The  operations  facilities  Include  the  physical  p1ant»  real 
estate,  temporary  structures,  housing.  Intermediate  shops, 
depots,  etc.,  required  to  support  operational  and  mainte- 
nance functions  associated  with  the  prime  system,  test  and 
support  equipment,  and  training  equipment  throughout  the 
operations  phase,  storage  for  space/repair  parts,  and  data, 
quarters  for  operator  and  maintenance  personnel,  and  training 
operations.  Capital  equipment  and  utilities  are  considered 
as  part  of  facilities  [6.  page  9]. 

TEST  AND  SUPPORT  EQUIPHENT: 

Test  and  support  equipment  used  In  operations  includes  all 
tools,  monitoring  and  checkout  equipment,  metrology  and 
calibration  equipment,  work  stands  and  handling  equipment 
required  to  support  scheduled  and  unscheduled  maintenance 
actions  associated  with  the  system.  This  Includes  external 
test  equipment  and  built-in  test  (BIT)  equipment  which  Is 
considered  to  be  part  of  the  system  [6,  page  8]. 

RElIABILITY/HAINTAINABILITY/AVAl LABILITY; 

Rellahlllty,  maintainability,  and  availability  are  those 
concepts  (as  defined  earlier)  which  during  operations, 
concern  the  prime  system  as  well  as  the  support  and  test 
equipment.  Operations  Is  usually  the  crucial  phase  In 
the  assessment  of  adequacy  of  these  characteristics,  and 
Is  the  source  of  the  requirements  that  define  maintain- 
ability, reliability  and  availability  [14.  page  180]. 
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ORGANIZATION  PLAN: 


The  organization  plan  for  operations  develops  an  organi- 
zatlonal  structure  for  the  accomplishment  of  the  tasks 
required  In  the  operations  phase,  and  Includes  the  defl- 
nitlon  of  activities  and  phasing  required  to  Implement  the 
organization. 

PERSONNEL  AND  TRAINING: 

Personnel  and  training  Include  the  Identification  and 
programming  of  skills,  number  of  people,  and  training 
needed  to  accomplish  the  activities  of  the  operations 
phase. 

TECHNICAL  DATA: 

Technical  data  Identify  and  record  for  on-call  use  all 
technical  Information  necessary  for  the  efficient  oper- 
ation and  support  of  the  system  [14,  page  227]. 

SAF.TY; 

Safety  analysis  for  operations  Identifies  possible  hazard 
areas  and  warning  notices  In  the  operating  and  maintenance 
procedured.  Note  that  human  factors  are  closely  aligned 
with  system  safety,  and  that  safety  provides  a critical 
Input  Into  a^1  phases  of  the  life  cycle  while  It  Is 
either  a constraint  or  a criterion  In  the  development  of 
the  system. 

MANAGEMENT  INFORMATION: 

The  management  of  operations  Information  consists  of 
assembling  data  Into  a manageable  aggregate  for  user  eval- 
uation. It  provides  the  feedback  to  the  designer  a^  well 
as  to  the  user  from  the  system  concerning  conditions  about 
the  state  of  operations  activities.  It  also  usually  re- 
qurles  some  formatting  and  analysis,  and  Is  the  majoT 
Input  to  management  for  on-going  decisions  during  the 
operations  phase  [14,  page  232].  i 

ENVIRONMENTAL:  \ 

Environmental  considerations  In  the  operations  rhase  include 
all  effects  of  the  environment  on  the  system,  the  user,  and 
all  constituent  elements. 


RETIREMENT  PHASE 


ELEMENTS: 

FUTURE  DEMAND 
SUPPLY  SUPPORT 
MAINTENANCE  PLANNING 
COSTS 

FACILITIES 

TEST  AND  SUPPORT  EQUIPMENT 
ORGANIZATION  PLAN 
PERSONNEL  AND  TRAINING 
TRANSPORTATION  AND  HANDLING 
SAFETY 

MANAGEMENT  INFORMATION 
ENVIRONMENTAL 

FUTURE  DEMAND: 

In  the  retirement  phase,  future  utilization  of  the  system 
and/or  Its  components  must  be  considered  as  It  relates  to 
te'*>n1ca1  obsolescence,  wear  and  tear,  adaptation  to 
evolving  needs,  material  disposal,  etc. 

SUPPLY  SUPPORT: 

The  supply  support  during  retirement  consists  of  all  re- 
pairable spares  Cunits,  assemblies,  modules,  etc.},  repair 
parts,  consumables,  special  supplies  and  related  Inventories 
needed  to  support  scheduled  and  unscheduled  maintenance 
actions  associated  with  the  prime  equipment,  facilities, 
and  test  and  support  equipment  during  the  retirement  phase. 
Considerations  Include  each  maintenance  level  and  each 
geographical  location  where  spare/repair  parts  are  dis- 
tributed and  stocked,  the  distances  between  stockage  points, 
and  the  methods  of  material  distribution  [6,  page  8]. 

MAINTENANCE  PLANNING: 

Maintenance  planning  for  retirement  defines  the  support 
requirements  and  plans  for  maintenance  In  or^*^r  to  satisfy 
operational  goals  during  the  retirement  phase.  Concepts 
and  requirements  for  each  level  of  equipment  maintenance 
to  be  performed  are  established  [14,  page  224]. 

COSTS: 

The  cost  analysis  Involves  the  direct  and  Indirect  costs 
of  the  retirement  of  the  system  as  well  as  the  costs  of 
all  the  elements  considered  In  the  retirement  phase.  As 
^n  ea-ller  phases  the  definition  of  cost  categories  should 


be  consistent  with  the  requirements  of  USAF  and  the  ability 
to  evaluate  system  performance  against  criteria  resulting 
from  system  requirements. 

FACILITIES: 

Farllltles  needed  during  the  retirement  phase  Include  the 
physical  plant,  real  estate,  temporary  structures,  housing. 
Intermediate  shops,  depots,  etc.,  required  to  support  the 
deactivation,  disassembly,  storage,  redistribution,  des- 
truction, etc.,  of  the  system,  test  and  support  equipment, 
training  equipment,  and  training  operations.  Capital 
equipment  and  utilities  are  considered  as  part  of  facilities 
[6,  page  9]. 

TEST  AND  SUPPORT  EQUIPMrNT: 

Test  and  support  equipment  used  In  the  retirement  phase 
includes  all  tools,  monitoring  and  checkout  equipment, 
metrology  and  calibration  equipment,  work  stands  and 
handling  equipment  required  to  support  scheduled  and 
unscheduled  maintenance  actions  associated  with  the  retired 
system  [6,  page  8]. 

ORGANIZATION  PLAN; 

The  organization  plan  for  retirement  of  the  system  develops 
an  organizational  structure  for  the  accomplishment  of  the 
tasks  required  In  the  retirement  phase. 

PERSONNEL  AND  TRAINING; 

Personnel  and  training  considerations  during  retirement  in- 
clude the  Idantificatlon  and  programming  of  skills,  number 
of  people,  and  training  needed  to  accomplish  the  activities 
of  the  retirement  phase  [14,  page  228]. 

TRANSPORTATION  AND  H ANDLING : 

The  transportation  and  handling  needs  of  the  retirement 
phase  Include  special  provisions,  reusable  containers, 
and  supplies  necessary  to  support  packaging,  preservation, 
storage,  handling,  and/or  transportation  of  the  primary 
system,  support  equipment,  spare/repair  parts,  personnel, 
technical  data,  and  facilities  [6,  page  9]. 

SAFETY ; 

Safety  considerations  during  the  retirement  phase  are 
needed  to  protect  the  user  against  failures  due  to  aging 
and  obsolescence  of  the  system,  as  well  as  the  activity 


to  withdraw  the  equipment  from  active  Inventory. 

MANAGEMENT  INFORMATION; 

The  management  of  Information  during  retirement  consists 
of  assembling  data  Into  a manageable  aggregate  for  user 
evaluation.  It  provides  the  feedback  to  the  designer  as 
well  as  to  the  user  from  the  system  concerning  conditions 
about  the  state  of  the  retirement  activities.  K also 
usually  requires  some  formatting  and  analysis  [14,  page 
232]. 

ENVIRONMENTAL; 

Environmental  considerations  during  the  retirement  phase 
Include  the  methods  of  disposal  which  must  be  consistent 
with  ecological  and  environmental  requirements.  This 
Involves  the  study  of  the  effects  of  the  retirement  of  the 
system  on  the  environment  [6,  page  275]. 
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APPENDIX  B 


HUMAN  FACTORS  REFERENCE  BASE 

This  appendix  Is  an  adaptation  of  the  bibliography  on 
the  morphology  of  design  with  Inclusion  of  human  factors 
[15].  The  appendix  provides  a bibliography  of  human  fac- 
tors literature  of  Interest  to  systems  designers  and  re- 
presents an  Initial  effort  aimed  &t  demonstrating  the 
feasibility  of  bridging  the  communications  gap  between  the 
systems  design  engineer  and  the  human  factors  specialist. 
This  effort  Is  limited  to  the  extent  necessary  to  accomplish 
this  goal.  A reference  list  of  some  form  Is  necessary  If 
the  design  engineer  Is  to  Include  relevant  criteria  Into 
the  design  analysis  to  Insure  adequate  consideration  of  the 
Inclusion  of  human  factors  In  system  design.  Hopefully, 
this  bibliography  will  provide  an  adequate  basis  for  the 
Inclusion  of  each  respective  human  factor. 

The  human  factors  reference  base  relates  the  current 
literature  to  the  previously  defined  thrlteen  human  factors 
categories  (see  Para.  4.3)  and  provides  a basis  for  estab- 
lishing a formal  three  dimensional  relationship  among 
human  factors,  the  steps  In  the  design  morphology,  and  the 
existing  literature.  Note  that  this  relationship  Is  best 
represented  by  a three  dimensional  matrix.  The  bibliog- 
raphy [15]  Is  reviewed  and  the  Individual  references  which 
pertain  to  specific  human  factors  are  sorted  with  regard 


to  the  human  factor  category  or  categories  to  which  they 
refer.  The  thirteen  groups  of  references  are  then  numbered 
to  facilitate  access.  For  example  a reference  number  of 
7.0  refers  to  all  the  references  listed  In  human  factors 
category  number  seven  (Man-Machine  Interface),  while  a 
reference  number  of  7.2  refers  specifically  to  article 
number  two  (2)  In  category  number  seven  (7). 

Future  study  should  extend  these  reference  lists  and 
attempt  to  Identify  "standard"  data  elements  of  Importance 
to  system  design  for  given  classes  of  equipment. 
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sign  morphology  to  current  USAF  methodology  for 
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ce  the  decision  structure  of  design,  and  clari- 
sub.iective  and  objective  requirements  which  are 
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inputs  to  the  decision  structure.  The  conceptual  framework  devel- 
oped as  an  effective  approach  to  the  solution  of  the  problem  of 
human  factors  inclusion  into  the  design  morphology  is  that  of 
a three  dimentional  matrix  representing  the  relationship  among 
human  factors,  the  design  steps,  and  the  current  literature.  This 
relationship  allows  for  explicit  human  factors  inclusion  during 
the  preliminary  design  phase  of  a new  system  and  the  resultant^ 
inclusion  in  the  criteria  function  for  the  optimal  design  configu- 
ration. 


